-- Logs begin at Thu 2021-12-09 00:29:41 UTC, end at Thu 2021-12-09 01:28:20 UTC. -- Dec 09 01:00:27.668830 dv-cinder-790535-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 09 01:00:27.678266 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 9 01:00:27 2021] *** Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: nodename: dv-cinder-790535-20-iscsi Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: machine: x86_64 Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: clock source: unix Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: pcre jit disabled Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: detected number of CPU cores: 4 Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: current working directory: / Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: detected binary path: /usr/bin/uwsgi-core Dec 09 01:00:27.681141 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: your processes number limit is 47680 Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: your memory page size is 4096 bytes Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: detected max file descriptor number: 2048 Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: lock engine: pthread robust mutexes Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: thunder lock: enabled Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 09 01:00:27.681773 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 09 01:00:27.725543 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: Python main interpreter initialized at 0x563def5b39c0 Dec 09 01:00:27.725543 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: python threads support enabled Dec 09 01:00:27.725543 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: your server socket listen backlog is limited to 100 connections Dec 09 01:00:27.725543 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: your mercy for graceful operations on workers is 90 seconds Dec 09 01:00:27.725868 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: mapped 403077 bytes (393 KB) for 2 cores Dec 09 01:00:27.725942 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: *** Operational MODE: preforking *** Dec 09 01:00:27.726199 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: *** uWSGI is running in multiple interpreter mode *** Dec 09 01:00:27.726199 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: spawned uWSGI master process (pid: 101887) Dec 09 01:00:27.726408 dv-cinder-790535-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 09 01:00:27.730395 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: spawned uWSGI worker 1 (pid: 101888, cores: 1) Dec 09 01:00:27.730395 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: spawned uWSGI worker 2 (pid: 101889, cores: 1) Dec 09 01:00:27.730395 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 09 01:00:29.460850 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:00:29.460850 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: from cryptography.utils import int_from_bytes Dec 09 01:00:29.462533 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:00:29.462533 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: from cryptography.utils import int_from_bytes Dec 09 01:00:29.462533 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:00:29.462533 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: from cryptography.utils import int_from_bytes Dec 09 01:00:29.463089 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:00:29.463089 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: from cryptography.utils import int_from_bytes Dec 09 01:00:32.061443 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 01:00:32.062061 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 01:00:32.062146 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 01:00:32.062146 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 01:00:32.062600 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 01:00:32.062680 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 01:00:32.062754 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 01:00:32.062823 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 01:00:32.062894 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 01:00:32.063135 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 01:00:32.063234 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.063499 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.063652 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.063825 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.063930 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064142 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064242 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064462 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064565 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064773 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.064866 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065082 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065179 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065404 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065496 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065723 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065806 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.065986 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066070 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066301 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066425 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066643 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066735 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-20-iscsi {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.066964 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067048 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-20-iscsi {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067274 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067358 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067577 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067672 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067887 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.067977 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068192 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068275 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068492 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068583 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068811 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.068900 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.069122 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.069314 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.069619 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.069766 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.069929 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.070064 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.070235 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.070663 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.070845 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.070993 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071140 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071247 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071334 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071507 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071603 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071821 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.071915 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072127 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072212 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072447 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072542 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072753 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.072838 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073147 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-20-iscsi {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073249 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-20-iscsi {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073464 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073555 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073787 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.073873 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074071 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074166 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074502 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074606 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074812 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.074912 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075118 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075210 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075436 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075522 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075756 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.075847 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076062 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076146 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076388 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076479 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076703 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.076794 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077020 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077114 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077337 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077422 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077637 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077721 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.077943 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078044 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078246 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078329 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078589 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078685 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078896 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.078987 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079197 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079287 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079447 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079533 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079752 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.079838 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080071 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080156 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080387 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080481 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080704 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080793 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.080956 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081048 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081205 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081301 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081519 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081611 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081837 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.081922 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082143 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082235 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082472 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082570 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082776 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.082861 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083080 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083166 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083384 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083476 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083688 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083773 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.083991 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084080 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084294 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084383 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084608 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084699 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.084920 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085004 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085237 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085330 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085542 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085626 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.085858 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086047 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086350 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086531 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086636 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086727 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.086916 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087007 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087251 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087343 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087568 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087659 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087872 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.087956 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088189 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088277 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088506 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088597 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088811 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.088896 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089117 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089201 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089422 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089518 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089740 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.089823 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090077 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090161 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090422 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090656 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090744 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.090914 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091000 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091218 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091313 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091524 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091608 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091842 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.091982 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092147 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092246 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092454 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092537 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092756 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.092842 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093051 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093147 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093358 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093452 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093663 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093745 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.093966 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094065 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094271 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094355 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094600 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094729 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.094909 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095033 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095218 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095337 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095527 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095640 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095848 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.095935 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096170 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096336 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096472 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096557 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096781 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.096874 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097089 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097173 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097397 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097489 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097718 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.097804 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098026 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098122 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098330 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098458 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098660 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098788 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.098974 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099058 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099276 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099358 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099580 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099671 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099887 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.099977 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100190 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100280 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100494 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100579 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100796 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.100879 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.101098 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.101180 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.101402 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.101487 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.102240 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.102429 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.102592 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.102758 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.102935 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103035 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103190 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103277 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103497 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103591 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103801 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.103887 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104107 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104193 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104410 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104507 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104712 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.104804 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105011 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105096 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105329 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105427 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105645 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105730 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.105953 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.106045 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.106260 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.106352 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.106843 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.106929 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.107160 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:00:32.107253 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.107495 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.107581 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.107825 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.107909 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108146 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108228 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108462 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108547 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108792 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.108878 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109111 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109202 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109424 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109517 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109732 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.109814 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110042 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110135 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110356 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110500 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110697 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.110822 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111010 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111241 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111330 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111559 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111644 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111875 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.111960 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112193 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112302 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112522 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112615 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112841 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.112934 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113159 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113245 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113479 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113564 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113791 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.113885 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114108 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114245 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114447 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114537 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114773 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.114867 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115084 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115170 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115424 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115507 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115751 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.115848 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116059 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116143 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116382 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116475 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116696 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.116791 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.117012 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.117097 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.117889 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118046 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118196 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118353 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118520 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118611 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118852 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.118939 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119163 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119267 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119473 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119565 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119806 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.119900 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120121 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120215 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120425 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120516 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120726 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.120809 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121031 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121127 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121336 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121428 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121645 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121730 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.121948 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122041 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122265 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122432 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122610 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122696 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.122915 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123011 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123228 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123320 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123539 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123632 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123846 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.123929 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124154 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124237 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124458 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124556 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124762 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.124847 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125069 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125162 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125373 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125471 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125680 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125765 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.125990 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126081 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126297 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126410 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126625 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126710 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.126940 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127027 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127242 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127327 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127552 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127647 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127860 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.127951 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128171 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128258 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128480 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128573 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128791 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.128875 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129100 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129195 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129408 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129496 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129739 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.129834 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130063 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130147 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130382 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130510 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130706 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.130803 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131011 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131102 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131324 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131411 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131625 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131722 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.131932 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132023 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132231 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132316 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132536 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132631 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.132885 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133024 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133202 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133355 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133561 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133674 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.133922 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134010 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134231 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134315 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134562 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134650 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134867 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.134953 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135178 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135261 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135486 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135570 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135788 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.135875 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136090 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136182 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136393 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136479 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136739 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.136825 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137045 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137136 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137383 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137477 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137705 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.137797 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138019 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138158 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138338 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138484 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138674 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138759 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.138987 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139082 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139297 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139388 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139607 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139693 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.139920 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140015 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140228 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140314 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140547 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140632 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140857 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.140950 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141173 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141257 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141483 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141567 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141799 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.141893 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142103 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142187 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142438 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142561 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142746 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.142834 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143062 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143147 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143400 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143488 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143731 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.143823 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144044 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144130 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144361 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144445 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144667 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144761 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.144976 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145060 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145284 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145368 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145591 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145676 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145899 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.145990 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146207 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146302 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146546 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146646 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146857 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.146947 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147173 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147295 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147483 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147574 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147809 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.147933 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148105 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148247 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148462 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148590 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148816 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.148979 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149216 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149324 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149536 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149630 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149856 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.149942 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150182 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150277 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150521 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150611 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150835 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.150920 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151149 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151244 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151460 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151548 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151769 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.151856 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152073 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152160 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152379 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152465 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152691 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.152776 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153001 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153086 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153308 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153394 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153617 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153701 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.153921 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154008 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154228 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154313 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154562 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154704 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154870 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.154956 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155175 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155260 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155485 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155580 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155805 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.155891 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156114 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156200 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156422 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156517 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156731 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.156817 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157036 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157118 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157340 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157437 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157652 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157738 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.157961 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158044 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158267 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158351 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158595 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158691 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158902 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.158988 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159236 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159326 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159545 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159628 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159850 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.159938 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160168 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160254 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160482 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160574 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160788 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.160874 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161098 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161190 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161405 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161490 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161713 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.161806 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162021 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162106 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162333 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162435 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162665 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162810 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.162973 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163060 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163282 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163372 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163588 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163684 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163896 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.163984 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.164744 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.164889 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165096 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165255 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165370 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165500 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165630 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165809 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.165954 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.166115 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.166447 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.166549 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.166767 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.166880 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167201 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167333 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167525 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167668 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167849 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.167987 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168173 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168310 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168507 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168628 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168837 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.168923 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169155 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169249 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169466 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169558 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169786 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.169879 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170094 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170180 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170424 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170512 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170739 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.170841 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171047 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171132 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171355 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171442 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171661 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171755 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.171966 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172057 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172269 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172353 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172575 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172668 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172875 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.172959 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173178 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173262 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173509 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173606 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173815 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.173900 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174125 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174218 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174451 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174541 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174764 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.174865 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175067 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175159 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175372 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175463 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175683 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175781 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.175985 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176068 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176289 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176374 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176592 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176681 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.176933 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177026 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177239 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177324 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177573 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177662 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177881 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.177964 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178188 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178274 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178537 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178637 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178840 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.178926 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.179142 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.179225 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.179448 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.179534 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.179856 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180014 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180172 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180336 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180461 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180552 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180762 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.180849 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181074 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181174 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181386 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181472 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181698 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.181784 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182004 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182097 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182314 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182457 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182641 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182727 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.182951 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183048 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183255 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183347 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183557 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183642 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183863 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.183950 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184162 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184246 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184464 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184557 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184766 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.184851 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185070 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185154 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185372 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185455 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185678 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185770 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.185979 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186064 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186280 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186381 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186608 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186694 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186910 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.186997 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187211 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187305 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187514 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187606 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187819 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.187903 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188120 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188218 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188426 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188510 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188732 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.188859 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189032 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189126 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189333 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189418 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189635 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189719 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.189936 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190029 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190236 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190322 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190587 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190673 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190896 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.190990 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191208 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191294 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191513 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191598 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191818 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.191904 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192120 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192211 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192424 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192509 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192725 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.192808 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193029 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193113 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193331 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193416 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193633 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193717 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.193933 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194041 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194235 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194329 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194559 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194657 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194865 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.194949 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.195172 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.195783 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196012 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196188 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196329 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196542 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196654 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196857 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.196945 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197216 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197301 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197524 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197609 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197843 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.197930 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.198166 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.198251 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.198593 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.198745 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.198978 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199066 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199298 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199429 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199607 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199786 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.199926 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200124 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200239 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200470 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200563 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200809 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.200897 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201147 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201233 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201469 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201560 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201782 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.201876 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202094 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202187 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202444 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202532 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202772 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.202861 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203098 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203206 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203405 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203499 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203716 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.203802 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204027 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204120 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204338 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204436 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204649 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204734 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.204960 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205046 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205272 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205372 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205585 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205671 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205896 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.205981 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206204 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206414 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206540 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206639 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206848 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.206941 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207159 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207254 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207471 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207564 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207776 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.207862 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208097 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208191 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208406 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208497 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208711 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.208843 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209024 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209111 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209330 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209422 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209641 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209726 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.209947 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.210041 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.210265 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.210396 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.210613 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.210716 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.211638 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.211797 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.211947 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212093 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212304 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212400 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212620 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212706 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.212940 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213025 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213258 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213352 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213568 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213653 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213908 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.213992 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.214229 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.214323 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.214627 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.214712 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.214942 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215027 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215250 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215345 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215559 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215643 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215872 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.215957 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216201 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216287 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216512 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216598 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216822 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.216906 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217130 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217215 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217448 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217531 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217754 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.217837 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218080 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218166 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218414 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218534 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218757 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.218851 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219151 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219235 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219502 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219587 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219819 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.219916 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220174 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220258 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220504 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220590 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220829 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.220922 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221156 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221248 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221468 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221552 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221785 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.221871 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222097 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222181 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222454 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222540 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222779 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.222867 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223093 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223184 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223415 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223501 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223726 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.223813 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224048 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224132 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224364 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224449 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224681 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.224766 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225007 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225092 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225328 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225420 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225660 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.225744 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.226037 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.226192 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.226445 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.226703 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.226848 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227010 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227160 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227319 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227411 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227490 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227664 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227760 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.227972 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228060 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228282 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228368 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228597 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228691 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.228904 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229047 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229221 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229317 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229532 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229631 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229840 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.229924 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230148 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230243 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230489 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230655 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230804 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.230898 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.231112 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.231196 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.231685 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.231782 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232005 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232097 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232328 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232412 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232650 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232735 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.232954 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233038 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233280 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233366 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233596 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233684 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233900 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.233983 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234209 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234294 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234540 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234630 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234856 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.234942 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235169 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235264 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235497 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235582 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235823 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.235907 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236154 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236296 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236468 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236553 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236808 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.236894 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237128 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237222 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237448 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237532 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237772 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.237857 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238103 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238196 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238433 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238536 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238746 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.238831 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239060 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239146 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239369 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239454 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239680 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239765 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.239988 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240083 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240299 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240390 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240610 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240695 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.240918 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241011 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241227 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241317 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241540 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241635 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241845 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.241929 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242286 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242479 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242631 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242798 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242915 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.242996 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243136 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243224 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243443 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243538 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243791 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.243878 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244101 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244211 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244439 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244534 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244762 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.244857 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245087 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245180 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245413 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245505 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245724 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.245809 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246051 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246136 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246388 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246478 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246710 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.246796 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247032 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247118 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247351 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247445 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247669 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247754 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.247992 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248095 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248311 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248403 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248624 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248709 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.248943 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249028 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249258 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249343 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249577 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249660 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.249898 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.250100 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.250225 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.250468 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.250787 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.250873 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251103 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251203 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251422 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251508 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251740 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.251827 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252059 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252154 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252377 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252462 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252693 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.252778 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253006 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253091 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253321 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253408 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253639 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253723 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.253959 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254046 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254286 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254400 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254652 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254749 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.254973 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255062 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255292 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255378 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255613 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255708 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.255933 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256019 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256293 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256377 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256609 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256702 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.256920 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.257006 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.257238 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.257324 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.257559 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.257652 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.258428 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.258572 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.258856 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259018 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259169 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259300 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259490 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259611 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259809 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.259893 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260128 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260215 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260446 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260541 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260766 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.260863 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261085 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261171 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261408 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261493 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261731 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.261829 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262058 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262148 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262413 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262503 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262719 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.262822 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263042 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263128 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263364 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263565 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263691 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.263889 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264219 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264306 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264543 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264629 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264871 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.264962 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265193 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265279 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265517 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265602 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265839 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.265925 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266147 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266230 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266483 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266584 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266802 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.266889 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267112 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267195 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267419 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267511 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267736 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.267820 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268048 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268134 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268355 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268447 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268679 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268764 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.268986 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.269075 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.269313 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.269519 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.269630 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.269873 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270170 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270257 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270543 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270632 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270869 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.270954 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271192 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271284 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271505 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271592 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271835 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.271928 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272148 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272233 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272456 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272550 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272777 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.272862 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.273091 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.273176 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.273422 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.273511 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.274292 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.274485 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.274637 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.274789 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.274932 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275098 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275252 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275412 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275571 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275733 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.275885 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276044 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276206 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276378 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276518 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276692 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.276851 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277003 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277165 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277313 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277478 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277736 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277832 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.277915 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278096 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278224 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278440 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278560 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278754 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.278870 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279067 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279187 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279378 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279506 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279696 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.279829 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280007 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280101 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280321 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280410 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280630 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280716 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.280946 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281032 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281255 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281355 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281571 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281657 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281882 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.281977 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282190 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282275 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282532 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282619 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282844 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.282942 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283163 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283249 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283478 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283563 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283794 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.283892 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284110 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284232 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284427 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284514 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284778 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.284977 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.285102 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.285370 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.285643 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.285730 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286033 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286132 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286411 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286504 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286708 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.286793 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287025 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287123 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287341 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287438 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287671 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287759 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.287984 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288071 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288299 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288397 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288619 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288707 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.288936 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289044 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289300 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289469 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289643 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289747 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.289915 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290004 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290230 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290325 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290571 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290669 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290896 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.290990 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291217 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291303 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291541 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291635 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291863 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.291948 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292187 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292274 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292508 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292606 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292825 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.292920 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293141 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293228 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293456 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293543 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293770 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.293855 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294088 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294175 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294427 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294531 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294752 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.294837 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295063 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295159 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295394 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295487 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295706 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.295799 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296095 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296230 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296421 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296516 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296734 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.296857 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297059 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297158 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297374 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297459 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297683 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.297768 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298007 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298102 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298323 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298425 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298677 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298762 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.298995 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299083 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299330 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299417 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299655 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299747 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.299965 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300064 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300274 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300367 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300581 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300668 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300902 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.300990 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301210 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301300 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301530 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301624 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301862 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.301947 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302187 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302274 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302530 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302634 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302858 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.302944 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303170 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303263 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303496 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303592 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303810 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.303897 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304127 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304219 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304441 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304528 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304830 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.304999 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305144 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305295 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305457 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305585 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305753 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.305848 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306068 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306156 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306399 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306490 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306717 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.306816 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307048 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307135 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307368 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307464 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307675 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.307762 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308001 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308095 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308322 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308407 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308643 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308737 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.308961 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309057 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309277 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309370 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309594 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309679 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.309908 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310005 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310227 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310315 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310567 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310663 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310886 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.310973 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311201 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311286 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311519 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311613 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311840 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.311933 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312164 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312251 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312493 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312585 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312823 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.312909 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313171 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313255 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313488 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313583 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313836 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.313922 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.314166 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.314293 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.314507 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.314674 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.314825 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.315012 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.315134 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.315335 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.315423 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 01:00:32.315656 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.315970 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:00:32.316221 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 01:00:32.339477 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_db.sqlalchemy.engines [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.340422 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.407708 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.context [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43af9349-0699-4dfb-9be6-d0c0382396d7(cell1) {{(pid=101889) load_cells /opt/stack/nova/nova/context.py:464}} Dec 09 01:00:32.407896 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.context [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43af9349-0699-4dfb-9be6-d0c0382396d7(cell1) {{(pid=101888) load_cells /opt/stack/nova/nova/context.py:464}} Dec 09 01:00:32.411848 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:00:32.412049 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_concurrency.lockutils [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:00:32.413452 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:00:32.413650 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_concurrency.lockutils [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:00:32.414544 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:00:32.414734 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_concurrency.lockutils [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:00:32.416506 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:00:32.416745 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_concurrency.lockutils [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:00:32.426871 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.429311 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.433341 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_db.sqlalchemy.engines [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.435567 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_db.sqlalchemy.engines [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.603778 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG oslo_db.sqlalchemy.engines [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.606959 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:00:32.949359 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: WARNING keystonemiddleware.auth_token [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:00:32.953905 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: WARNING keystonemiddleware.auth_token [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:00:32.955974 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: WARNING keystonemiddleware.auth_token [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:00:32.960767 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: WARNING keystonemiddleware.auth_token [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:00:33.299797 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: WARNING keystonemiddleware.auth_token [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:00:33.304886 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: WARNING keystonemiddleware.auth_token [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:00:33.305277 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: WARNING keystonemiddleware.auth_token [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:00:33.310179 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563def5b39c0 pid: 101888 (default app) Dec 09 01:00:33.310418 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: WARNING keystonemiddleware.auth_token [None req-e0f17307-4de5-4c8b-a4cd-26ad937a265d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:00:33.312285 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:00:33.313469 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Dec 09 01:00:33.313878 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu Dec 9 01:00:33 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:00:33.315733 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563def5b39c0 pid: 101889 (default app) Dec 09 01:01:56.248984 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:01:56.250011 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 09 01:01:56.250457 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:01:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:01:56.678982 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-6b6ffade-b5ce-4988-b715-62d0ce4b0ee9 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:01:56.708004 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-6b6ffade-b5ce-4988-b715-62d0ce4b0ee9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448482 Dec 09 01:01:56.708876 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Dec 9 01:01:56 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:01:59.127014 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:01:59.127935 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-e109fc09-1098-44ef-9c3b-65435a077868 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 09 01:01:59.128318 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:01:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:01:59.196179 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-4cac66f6-83d7-4606-ba5a-5f4f9cb71324 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:01:59.216735 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:01:59.216735 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:01:59.246455 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-4cac66f6-83d7-4606-ba5a-5f4f9cb71324 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111162 Dec 09 01:01:59.247347 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:01:59 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:01:59.488978 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-d0faf46a-e5be-4ed7-ac1b-de128c90928d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:01:59.492328 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:01:59.492328 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: warnings.warn(msg) Dec 09 01:01:59.540862 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-d0faf46a-e5be-4ed7-ac1b-de128c90928d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284259 Dec 09 01:01:59.541662 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Dec 9 01:01:59 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:01.969407 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-4cac66f6-83d7-4606-ba5a-5f4f9cb71324 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:01.970533 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-4cac66f6-83d7-4606-ba5a-5f4f9cb71324 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Dec 09 01:02:01.971305 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:02.090788 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-12573d6d-b42c-4ca8-9e2b-deb0d37b46a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:02.112405 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:02:02.112405 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: warnings.warn(msg) Dec 09 01:02:02.139035 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-12573d6d-b42c-4ca8-9e2b-deb0d37b46a2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160721 Dec 09 01:02:02.142521 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:02.153718 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-257f25ea-1fce-4062-9f0b-871d233d92b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:02.155222 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:02:02.155222 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:02:02.190958 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-257f25ea-1fce-4062-9f0b-871d233d92b3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040976 Dec 09 01:02:02.198948 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Dec 9 01:02:02 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:04.700070 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-12573d6d-b42c-4ca8-9e2b-deb0d37b46a2 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:04.701233 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-12573d6d-b42c-4ca8-9e2b-deb0d37b46a2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Dec 09 01:02:04.701761 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:04.760447 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-5038f8e5-0a56-4f82-a1be-f4b4e37125d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "id": "d2", "swap": 0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:04.784004 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-5038f8e5-0a56-4f82-a1be-f4b4e37125d0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075567 Dec 09 01:02:04.784563 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:04.798278 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-2ffe629c-3287-44c1-a3a1-e92ba2ee2e9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:04.822914 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-2ffe629c-3287-44c1-a3a1-e92ba2ee2e9d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029155 Dec 09 01:02:04.823822 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Dec 9 01:02:04 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:02:07.211954 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-5038f8e5-0a56-4f82-a1be-f4b4e37125d0 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:07.213055 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-5038f8e5-0a56-4f82-a1be-f4b4e37125d0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Dec 09 01:02:07.213558 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:07.272029 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-74a61620-921a-47a7-9614-a98c7936ea24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "swap": 0, "name": "ds2G"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:07.291004 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-74a61620-921a-47a7-9614-a98c7936ea24 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071198 Dec 09 01:02:07.291543 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:07.304306 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-5aa127d0-db92-403d-8c4e-ebcc4194ca64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:07.326750 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-5aa127d0-db92-403d-8c4e-ebcc4194ca64 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026803 Dec 09 01:02:07.327315 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Dec 9 01:02:07 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:09.817764 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-74a61620-921a-47a7-9614-a98c7936ea24 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:09.818798 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-74a61620-921a-47a7-9614-a98c7936ea24 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Dec 09 01:02:09.819198 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:09.886233 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:09.905058 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079207 Dec 09 01:02:09.905771 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:09.918179 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-55bf79b1-714f-4cfd-9092-cb0d30244f22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:09.940973 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-55bf79b1-714f-4cfd-9092-cb0d30244f22 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026458 Dec 09 01:02:09.942105 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Thu Dec 9 01:02:09 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:12.374228 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:12.375277 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 09 01:02:12.375675 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:12.445197 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-a6069629-5a3b-4ae5-99a4-94253902dad3 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:12.490174 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-a6069629-5a3b-4ae5-99a4-94253902dad3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.106576 Dec 09 01:02:12.491383 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Dec 9 01:02:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:14.884283 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:14.885292 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-2574d97a-d47a-43c9-897b-560da936b0eb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 09 01:02:14.885847 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:14.978287 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-152314e9-c7ef-4934-b745-3c297297032a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:14.999596 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-152314e9-c7ef-4934-b745-3c297297032a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.106694 Dec 09 01:02:15.000247 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:14 2021] POST /compute/v2.1/flavors => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:02:15.013098 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-7db74d9d-0016-445d-8e8c-d60d6e1f0c3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:15.037244 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-7db74d9d-0016-445d-8e8c-d60d6e1f0c3e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027689 Dec 09 01:02:15.037836 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Dec 9 01:02:15 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:17.779206 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-152314e9-c7ef-4934-b745-3c297297032a admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:17.780218 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-152314e9-c7ef-4934-b745-3c297297032a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 09 01:02:17.780617 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:17.838799 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-fa82bf1b-0239-414d-ac4b-7e971ea0142b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "disk": 20, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:17.857027 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-fa82bf1b-0239-414d-ac4b-7e971ea0142b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069657 Dec 09 01:02:17.857666 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:17 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:17.869605 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-ee3d3182-c3b0-4d37-8528-1a166e6776cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:17.891754 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-ee3d3182-c3b0-4d37-8528-1a166e6776cc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025753 Dec 09 01:02:17.892318 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Dec 9 01:02:17 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:20.315907 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-fa82bf1b-0239-414d-ac4b-7e971ea0142b admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:20.317010 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-fa82bf1b-0239-414d-ac4b-7e971ea0142b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Dec 09 01:02:20.317426 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:20.386764 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-7e8ea421-a1f6-4be6-b5e4-436b63171451 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "name": "m1.medium", "swap": 0}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:20.408332 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-7e8ea421-a1f6-4be6-b5e4-436b63171451 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083989 Dec 09 01:02:20.408893 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:20 2021] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:20.422647 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-62c866ae-7037-4608-a495-30d8a8874583 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:20.448078 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-62c866ae-7037-4608-a495-30d8a8874583 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028930 Dec 09 01:02:20.448664 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Dec 9 01:02:20 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:22.936960 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-7e8ea421-a1f6-4be6-b5e4-436b63171451 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:22.937965 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-7e8ea421-a1f6-4be6-b5e4-436b63171451 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Dec 09 01:02:22.938401 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:23.004263 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-0b0d1a0b-916e-469a-834e-64d9387ac4e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:23.023565 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-0b0d1a0b-916e-469a-834e-64d9387ac4e4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078029 Dec 09 01:02:23.024175 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:23.036727 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-ea7c04ad-c1a8-4336-9dc9-9d2ed47c0112 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:23.059505 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-ea7c04ad-c1a8-4336-9dc9-9d2ed47c0112 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026832 Dec 09 01:02:23.074401 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Dec 9 01:02:23 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:25.558108 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-0b0d1a0b-916e-469a-834e-64d9387ac4e4 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:25.559150 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-0b0d1a0b-916e-469a-834e-64d9387ac4e4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Dec 09 01:02:25.559559 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:02:25.619301 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:25.638130 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071915 Dec 09 01:02:25.638712 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Thu Dec 9 01:02:25 2021] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:25.651984 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-79e7c714-9743-413f-bfcc-67730b516881 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:25.679176 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-79e7c714-9743-413f-bfcc-67730b516881 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031018 Dec 09 01:02:25.679753 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Thu Dec 9 01:02:25 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:02:47.008964 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:47.009953 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Dec 09 01:02:47.010353 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:02:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:47.068151 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-938601f1-6592-48ec-808a-8bfac30a0ee6 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:47.085656 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-938601f1-6592-48ec-808a-8bfac30a0ee6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068886 Dec 09 01:02:47.086217 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Dec 9 01:02:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:48.698600 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:48.699595 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-4fa59615-5aad-46d4-9538-45f2000a7c0d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 09 01:02:48.699992 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:48.890077 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-23a7c7ec-bf5c-47bd-822d-5dab4978f9aa admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:48.896487 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.wsgi [None req-23a7c7ec-bf5c-47bd-822d-5dab4978f9aa admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 09 01:02:48.897047 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-23a7c7ec-bf5c-47bd-822d-5dab4978f9aa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:48.897848 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-23a7c7ec-bf5c-47bd-822d-5dab4978f9aa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059296 Dec 09 01:02:48.898381 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Dec 9 01:02:48 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:48.908161 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-425e2dba-491e-4e2d-9d11-d86b7aeb066a admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:48.928787 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-425e2dba-491e-4e2d-9d11-d86b7aeb066a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024134 Dec 09 01:02:48.929314 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:48.939161 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-2151d71c-af74-41dd-be20-edba0972f850 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:48.960670 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-2151d71c-af74-41dd-be20-edba0972f850 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024952 Dec 09 01:02:48.961211 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:48.970791 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-d6ebba2e-e50f-4a91-a55f-49dfd7a16632 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:48.976920 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.wsgi [None req-d6ebba2e-e50f-4a91-a55f-49dfd7a16632 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 09 01:02:48.977493 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-d6ebba2e-e50f-4a91-a55f-49dfd7a16632 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:48.978546 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-d6ebba2e-e50f-4a91-a55f-49dfd7a16632 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011012 Dec 09 01:02:48.979057 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Dec 9 01:02:48 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:50.460358 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-2151d71c-af74-41dd-be20-edba0972f850 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:50.461379 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-2151d71c-af74-41dd-be20-edba0972f850 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Dec 09 01:02:50.461796 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:50.651994 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-a96b10b7-29fd-4309-ad0c-5398a96a53b7 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:50.657182 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.wsgi [None req-a96b10b7-29fd-4309-ad0c-5398a96a53b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 09 01:02:50.657749 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-a96b10b7-29fd-4309-ad0c-5398a96a53b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:50.658590 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-a96b10b7-29fd-4309-ad0c-5398a96a53b7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059423 Dec 09 01:02:50.659143 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Dec 9 01:02:50 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:50.668957 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-894c0e18-a9aa-4f36-91d7-695beccfeb11 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:50.682450 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-894c0e18-a9aa-4f36-91d7-695beccfeb11 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017021 Dec 09 01:02:50.682991 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:02:50.693244 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-d6afccf9-6b8c-4a3a-b04c-2bbee1250852 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:50.706435 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-d6afccf9-6b8c-4a3a-b04c-2bbee1250852 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017155 Dec 09 01:02:50.706950 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:02:50.716734 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e010ded1-e610-44fd-aebe-ce462b3ae7c4 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:50.722098 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.wsgi [None req-e010ded1-e610-44fd-aebe-ce462b3ae7c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 09 01:02:50.722684 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e010ded1-e610-44fd-aebe-ce462b3ae7c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:50.723462 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e010ded1-e610-44fd-aebe-ce462b3ae7c4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010344 Dec 09 01:02:50.723968 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu Dec 9 01:02:50 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:52.227190 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-d6afccf9-6b8c-4a3a-b04c-2bbee1250852 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:52.228174 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-d6afccf9-6b8c-4a3a-b04c-2bbee1250852 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 09 01:02:52.228823 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:52.423874 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e49c4ee1-7456-4ccb-9fed-6a4d2f19b774 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:52.429945 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.wsgi [None req-e49c4ee1-7456-4ccb-9fed-6a4d2f19b774 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 09 01:02:52.430535 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e49c4ee1-7456-4ccb-9fed-6a4d2f19b774 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:52.431345 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e49c4ee1-7456-4ccb-9fed-6a4d2f19b774 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057501 Dec 09 01:02:52.431855 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:02:52 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 09 01:02:52.441944 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-634c90cb-52f5-41b3-9304-4130b42a4ec0 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:52.454923 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-634c90cb-52f5-41b3-9304-4130b42a4ec0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017033 Dec 09 01:02:52.455837 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:52.467149 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:52.481041 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018915 Dec 09 01:02:52.481602 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu Dec 9 01:02:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:02:52.491988 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-47a2ad33-b418-46cd-9756-ca5f04533a5a admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:52.497159 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.wsgi [None req-47a2ad33-b418-46cd-9756-ca5f04533a5a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 09 01:02:52.497728 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-47a2ad33-b418-46cd-9756-ca5f04533a5a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:02:52.498561 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-47a2ad33-b418-46cd-9756-ca5f04533a5a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010104 Dec 09 01:02:52.499053 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:02:52 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 09 01:02:54.011749 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:54.012738 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Dec 09 01:02:54.013160 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:02:54.207876 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-b930bacc-4b0f-4786-a730-fc243fb4ec2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:54.227189 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-b930bacc-4b0f-4786-a730-fc243fb4ec2a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073923 Dec 09 01:02:54.227725 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Dec 9 01:02:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:02:55.739894 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:55.740916 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 09 01:02:55.741311 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:55.939472 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-990528cf-b814-4598-9e04-53bc348d1a0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:55.956836 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-990528cf-b814-4598-9e04-53bc348d1a0c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072992 Dec 09 01:02:55.957308 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Dec 9 01:02:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:57.448649 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:57.449639 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Dec 09 01:02:57.450027 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:57.639886 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-320e0b3a-d42a-46f0-8475-ac220347fba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:57.657173 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-320e0b3a-d42a-46f0-8475-ac220347fba1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068381 Dec 09 01:02:57.657765 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Dec 9 01:02:57 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:02:59.145818 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:02:59.146850 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Dec 09 01:02:59.147237 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:02:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:02:59.336429 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-e0820e69-ab3a-4631-ba14-010ea296a1b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:02:59.355544 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-e0820e69-ab3a-4631-ba14-010ea296a1b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069602 Dec 09 01:02:59.356020 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu Dec 9 01:02:59 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:03:00.854881 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:00.855877 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Dec 09 01:03:00.856269 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:03:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:03:01.044617 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-b3db7745-63e7-4466-b791-47fe5419259e admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:01.065639 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-b3db7745-63e7-4466-b791-47fe5419259e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070269 Dec 09 01:03:01.066105 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu Dec 9 01:03:00 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:03:48.912987 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:48.913980 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-e30785ee-668d-49fe-a522-aaea5f4086cb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 09 01:03:48.914419 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Thu Dec 9 01:03:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:03:48.973521 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-b1afbfbf-431e-4a54-a4db-4c2af2264893 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:48.992691 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-b1afbfbf-431e-4a54-a4db-4c2af2264893 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071998 Dec 09 01:03:48.993224 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Thu Dec 9 01:03:48 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:03:49.015873 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-144009d7-e5d1-47f1-97c8-1b1aec068921 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:49.024398 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-144009d7-e5d1-47f1-97c8-1b1aec068921 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012027 Dec 09 01:03:49.024936 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Thu Dec 9 01:03:49 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:03:49.037829 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-888c60ac-a209-4000-8428-f20219de6215 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:49.045377 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-888c60ac-a209-4000-8428-f20219de6215 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011083 Dec 09 01:03:49.045890 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Thu Dec 9 01:03:49 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:03:49.057438 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-b0f11aca-5136-4ac5-aa6a-97a3803a01b6 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:49.065146 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-b0f11aca-5136-4ac5-aa6a-97a3803a01b6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011065 Dec 09 01:03:49.065673 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Thu Dec 9 01:03:49 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:03:49.080428 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:03:49.088068 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012156 Dec 09 01:03:49.088595 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Thu Dec 9 01:03:49 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:05:12.874850 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-166a232f-0f72-4123-93c3-55b32a1167a2 tempest-verify_tempest_config-2022390959 tempest-verify_tempest_config-2022390959-project] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:05:12.876864 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-166a232f-0f72-4123-93c3-55b32a1167a2 tempest-verify_tempest_config-2022390959 tempest-verify_tempest_config-2022390959-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105981 Dec 09 01:05:12.877405 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1133 bytes} [Thu Dec 9 01:05:12 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:06:42.549703 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:42.550835 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Dec 09 01:06:42.551231 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:06:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:06:42.800769 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:42.801920 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:06:42.801920 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:06:42.803513 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:42.803956 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:42.804747 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:42.805173 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:42.837497 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-d70c930b-316e-45a6-9626-dbc9872b91af admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.146868 Dec 09 01:06:42.838034 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:06:42 2021] GET /compute/v2.1/os-services => generated 794 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:06:44.358953 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:44.360562 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Dec 09 01:06:44.360965 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:06:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:06:44.556865 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:44.558026 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:06:44.558026 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:06:44.559618 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:44.560062 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:44.560858 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:44.561294 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:44.581213 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-1411c106-e988-4ca1-8370-523c1562c397 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079768 Dec 09 01:06:44.581775 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:06:44 2021] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:06:56.533146 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:56.534191 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Dec 09 01:06:56.534620 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:06:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:06:56.734324 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:56.735509 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:06:56.735509 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:06:56.737027 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:56.737467 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:56.738253 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:56.738701 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:56.762594 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-6fba0b5d-1fc5-43fc-be79-7dc4b954b02e admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079446 Dec 09 01:06:56.763232 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 37/75] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:06:56 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:06:58.274502 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: DEBUG nova.api.openstack.wsgi [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] Calling method '>' {{(pid=101888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:58.275533 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: INFO nova.api.openstack.requestlog [None req-8ef6bc7c-0f87-47a7-8489-8140b478c536 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Dec 09 01:06:58.275946 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: [pid: 101888|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1074 bytes} [Thu Dec 9 01:06:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:06:58.473978 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG nova.api.openstack.wsgi [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] Calling method '>' {{(pid=101889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:06:58.475472 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:06:58.475472 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: warnings.warn(msg) Dec 09 01:06:58.476935 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:58.477383 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:58.478198 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:06:58.478648 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: DEBUG oslo_concurrency.lockutils [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:06:58.500327 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: INFO nova.api.openstack.requestlog [None req-4a1b8a39-6203-45b7-b1e1-a6c3971d154d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076339 Dec 09 01:06:58.500891 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: [pid: 101889|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1193 bytes} [Thu Dec 9 01:06:58 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:07:56.074194 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: Thu Dec 9 01:07:56 2021 - graceful shutdown triggered... Dec 09 01:07:56.074751 dv-cinder-790535-20-iscsi devstack@n-api.service[101888]: Gracefully killing worker 1 (pid: 101888)... Dec 09 01:07:56.075130 dv-cinder-790535-20-iscsi devstack@n-api.service[101889]: Gracefully killing worker 2 (pid: 101889)... Dec 09 01:07:56.076655 dv-cinder-790535-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 09 01:07:57.075338 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: worker 1 buried after 1 seconds Dec 09 01:07:57.075873 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: worker 2 buried after 1 seconds Dec 09 01:07:57.075873 dv-cinder-790535-20-iscsi devstack@n-api.service[101887]: goodbye to uWSGI. Dec 09 01:07:57.076929 dv-cinder-790535-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 09 01:07:57.077473 dv-cinder-790535-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 09 01:07:57.080308 dv-cinder-790535-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 09 01:07:57.089330 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 9 01:07:57 2021] *** Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: nodename: dv-cinder-790535-20-iscsi Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: machine: x86_64 Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: clock source: unix Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: pcre jit disabled Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: detected number of CPU cores: 4 Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: current working directory: / Dec 09 01:07:57.098332 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: detected binary path: /usr/bin/uwsgi-core Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: your processes number limit is 47680 Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: your memory page size is 4096 bytes Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: detected max file descriptor number: 2048 Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: lock engine: pthread robust mutexes Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: thunder lock: enabled Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 09 01:07:57.099218 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 09 01:07:57.147367 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: Python main interpreter initialized at 0x5602a76299c0 Dec 09 01:07:57.147367 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: python threads support enabled Dec 09 01:07:57.147367 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: your server socket listen backlog is limited to 100 connections Dec 09 01:07:57.147367 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: your mercy for graceful operations on workers is 90 seconds Dec 09 01:07:57.147802 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: mapped 403077 bytes (393 KB) for 2 cores Dec 09 01:07:57.147885 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: *** Operational MODE: preforking *** Dec 09 01:07:57.148158 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: *** uWSGI is running in multiple interpreter mode *** Dec 09 01:07:57.148158 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: spawned uWSGI master process (pid: 116055) Dec 09 01:07:57.148369 dv-cinder-790535-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 09 01:07:57.148980 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: spawned uWSGI worker 1 (pid: 116067, cores: 1) Dec 09 01:07:57.149342 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: spawned uWSGI worker 2 (pid: 116068, cores: 1) Dec 09 01:07:57.149745 dv-cinder-790535-20-iscsi devstack@n-api.service[116055]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 09 01:07:59.075812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:07:59.075812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: from cryptography.utils import int_from_bytes Dec 09 01:07:59.076580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:07:59.076580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: from cryptography.utils import int_from_bytes Dec 09 01:07:59.089254 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:07:59.089254 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: from cryptography.utils import int_from_bytes Dec 09 01:07:59.089780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 01:07:59.089780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: from cryptography.utils import int_from_bytes Dec 09 01:08:01.490793 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 01:08:01.491462 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 01:08:01.491462 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 01:08:01.492159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 01:08:01.492159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 01:08:01.492513 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.492803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.493133 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.493518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.493825 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.494102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.494452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.494789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.495124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.495390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.495719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.496042 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-20-iscsi {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.496445 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.496674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.496993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.497306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.497619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.497942 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.498285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.500402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.500402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.500402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.500402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.500402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.501075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.501075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.501225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.501485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.501772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.502094 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.502644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-20-iscsi {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.502869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.503178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.503493 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.503898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.504213 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.504527 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.504902 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.505245 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.505752 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.506253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.506841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.507160 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.507481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.507791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.508111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.508429 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.508763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.509064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.509377 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.509636 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.509948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.510273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.510628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.510954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.511209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.511464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.511787 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.512110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.512423 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.512735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.513419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.513419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.513700 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.514504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.514824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.515133 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.515459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.515781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.516102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.516415 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.516736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.517139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.517394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.517705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.518047 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.518392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.518703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.519027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.519350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.519660 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.519970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.520277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.520600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.520940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.521249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.521503 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.521809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.522118 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.522463 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.522778 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.523090 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.523401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.523706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.524017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.524328 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.524642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.524951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.525262 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.525570 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.525882 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.526112 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 01:08:01.526578 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.526668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 01:08:01.526752 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.526837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.526918 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 01:08:01.527120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.527286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 01:08:01.527446 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.527539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 01:08:01.527730 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.527916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528216 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528522 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.528852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.529015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.529194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.529361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530108 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530473 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530656 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530807 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.530959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.531998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-20-iscsi {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532298 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532452 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532754 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.532898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533663 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.533958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.534109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.534266 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.534458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.534671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.534840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.535017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.535171 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.535342 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.535699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.535852 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536645 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.536953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.537933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.538089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.538243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.538445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.538608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.538775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-20-iscsi {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.538928 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.539079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.539236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.539393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.539536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.539692 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.539847 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.540000 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.540158 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.540307 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.540451 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.540616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.540768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.540922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.541074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.541225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.541368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.541519 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.541672 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.541830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.541981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.542133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.542278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.542439 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.542607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.542761 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.542915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.543059 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.543201 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.543351 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.543503 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.543659 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.543812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.543963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.544114 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.544257 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.544408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.544561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.544712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.544864 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.545063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.545220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.545373 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.545542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.545893 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.546047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.546197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.546342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.546342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.546824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.546976 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.547131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.547282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.547436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.547590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.547746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.547907 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.548131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.548281 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.548433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.548584 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.548746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.548890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.549039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.549192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.549343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.549496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.549640 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.549782 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.549924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.550142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.550289 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.550463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.550618 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.550780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.550931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.551084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.551228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.551379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.551521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.551663 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.551812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.551963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.552113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.552268 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.552421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.552580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.552732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.552893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.553037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.553180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.553332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.553476 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.553633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.553776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.553918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.554067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.554217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.554394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.554571 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.554715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.554868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.555019 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.555163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.555323 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.555483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.555634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.555997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.556159 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.556312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.556466 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.556784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.556951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.557106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.557262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.557411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.557565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.557715 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.557866 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.558008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.558232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.558453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.558618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.558772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.558924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.559087 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.559232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.559930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.560106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.560271 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.560429 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.560581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.560757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.560904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.561062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.561221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.561375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.561542 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.561688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.561829 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.561973 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.562128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.562272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.562432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.562581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.562724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.562867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.562867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.563155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.563155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.563467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.563611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.563762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.563917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.564067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.564216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.564369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.564522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.564676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.564821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.564970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.565127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.565278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.565431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.565583 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.565733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.565909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.566265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.566465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.566627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.566921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.567075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.567218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.567384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.567542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.567686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.567847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.567993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.568149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.568377 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.568536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.568681 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.568824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.568973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.569132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.569877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.570038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.570038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.570336 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.570504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.570646 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.570802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.570954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.571106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.571261 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.571659 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.571820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.571965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.572117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.572270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.572426 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.572569 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.572712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.572868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.573026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.573184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.573341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.573485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.573627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.573849 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 01:08:01.574005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574637 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.574933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575692 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.575978 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.576930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.577299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.577469 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.577622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.577766 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.577909 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578051 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.578924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579068 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.579855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580302 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580494 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580804 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.580955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581107 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581423 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581722 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.581873 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582182 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.582948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583417 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583571 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583725 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.583878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584323 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584631 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.584933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.585848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586122 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.586874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.587953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588122 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588478 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.588986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589550 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589636 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.589908 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590190 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590779 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590869 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.590954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591130 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591392 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591576 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.591844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.592047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.592672 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.592774 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.592861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.592947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593128 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.593895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594118 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.594911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595141 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.595876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596092 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596784 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.596997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.597099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.597312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.597400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.597624 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.597973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598189 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598527 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.598950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599777 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.599877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600087 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600498 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.600801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601321 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601414 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.601946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.602924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603553 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.603971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604813 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.604905 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605125 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605741 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.605842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606065 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606182 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.606837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.607726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.607831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.607909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.607980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.607980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608201 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608656 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.608941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609845 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.609927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.610155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.610246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611231 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.611847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.612617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.612724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.612820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.612917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613642 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613779 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.613871 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614102 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.614835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.615157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.615486 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.615648 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.615807 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.615988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616136 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.616969 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617291 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617392 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.617931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.618927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619371 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619862 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.619962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620491 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.620909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621562 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.621855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622422 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622718 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.622819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623365 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623458 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623774 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.623991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.624922 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625266 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625476 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625570 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.625890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626200 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.626860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.627809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628447 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628672 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.628986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629444 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.629920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630238 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.630908 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631834 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.631996 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632455 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.632927 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633743 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.633885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634503 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.634813 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635125 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635456 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635653 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.635970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636062 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636284 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636687 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636909 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.636999 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.637941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.638149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.638242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.638510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.638606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.639367 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.639507 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.639753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.639857 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640186 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.640821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641024 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.641886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642152 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642710 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.642802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.643987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644752 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.644957 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645051 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645587 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645687 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.645907 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646220 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646663 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646880 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.646979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.647920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648444 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648546 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.648862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.649889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650437 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.650863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651711 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.651842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652134 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.652971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653291 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.653918 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.654022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.654241 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.654341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655654 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655864 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.655959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.656183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.656364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.656499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.656695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.656796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657013 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657439 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.657983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658296 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658423 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.658954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659584 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659685 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.659999 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660319 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.660914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661229 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.661847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.662831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663364 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663465 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.663774 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664095 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664730 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.664941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665583 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.665982 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.666973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.667181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.667281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.667536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.667721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.667899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668214 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668656 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.668946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669094 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.669985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670506 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670642 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.670960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671054 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.671911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.672943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673254 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673472 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.673886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674089 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.674854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675475 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.675845 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676663 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676755 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.676985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677409 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.677953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.678939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679031 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679566 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.679886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680008 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680207 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.680951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681072 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681266 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.681921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682865 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.682959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683199 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.683946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.684938 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.685178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.685279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.685508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.685600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.685896 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686323 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.686913 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687329 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687537 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687673 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687857 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.687957 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688267 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688493 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.688904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689125 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689436 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689540 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689751 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.689843 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.690835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691042 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691136 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691371 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691710 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.691802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692034 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692763 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.692977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693298 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.693904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694250 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694497 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.694940 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695784 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.695886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696435 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.696881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.697907 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.698871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699020 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699222 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699769 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.699917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700178 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700415 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700747 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.700842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.701070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.701164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.701903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.702989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703220 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.703954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704262 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.704889 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705096 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705410 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705502 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.705881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706033 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706343 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.706973 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707371 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.707914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708634 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.708941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709152 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709468 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709778 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.709872 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710567 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710747 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.710895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711169 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.711791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712645 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.712970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713080 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.713920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714023 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714342 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.714916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.715202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.715306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.715529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.715751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.715885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716232 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716546 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716729 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.716844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717104 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717575 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717747 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.717894 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718213 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.718850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719051 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.719825 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720160 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.720795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721030 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.721989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.722091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.722312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.722440 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.722957 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723214 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723308 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.723950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.724897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.725845 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.726902 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727568 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727782 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.727890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728526 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.728932 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729254 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729426 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.729935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730787 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.730952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.731916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.732023 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.732237 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.732340 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733239 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733415 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.733836 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734739 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.734833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735161 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.735959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736409 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.736935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737050 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737245 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737660 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.737992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.738203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.738306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.738546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.738718 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.738881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739606 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.739929 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740736 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.740932 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741259 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.741956 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742612 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742726 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.742936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743031 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743882 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.743983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744517 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744829 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.744931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.745146 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.745241 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.745460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.745579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.745709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 01:08:01.745804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.746071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.746410 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.746720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.747049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.747363 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.747676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.748001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.748378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.748713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.749030 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.749350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.749706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.750036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.750604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.750994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.751329 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.751681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.752031 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.752350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.752667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.752982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.753337 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.753626 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.753944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.754262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.754606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.754928 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.755248 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.755567 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.755883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.756201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.756524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.756874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.757201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.757527 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.757852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.758176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.758522 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.758840 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.759158 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.759475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.759805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.760141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.760463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.760777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.761205 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.761529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.761854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.762183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.762532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.762866 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.763208 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.763509 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.764431 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.764789 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.765133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.765483 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.765822 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.766157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.766499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.766818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.767794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.767794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.767794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.768100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.768410 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.768743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.769062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.769394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.769530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:01.769714 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.770046 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.770397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.770729 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.771048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.771390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.771708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.772029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.772346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.772664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.772982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.773300 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.773638 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.773967 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.774281 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.774661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.774983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.775314 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.775639 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.775959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.776296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.776615 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.776941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.777255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.777574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.777897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.778222 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.778582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.778920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.779250 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.780166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.780529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.780854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.781210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.781548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.781874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.782195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.782545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 01:08:01.782799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 01:08:01.804944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_db.sqlalchemy.engines [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:01.836564 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.context [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43af9349-0699-4dfb-9be6-d0c0382396d7(cell1) {{(pid=116068) load_cells /opt/stack/nova/nova/context.py:464}} Dec 09 01:08:01.840865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:01.843235 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:01.843929 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:01.845906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:01.859274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:01.860814 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:01.872757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.context [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43af9349-0699-4dfb-9be6-d0c0382396d7(cell1) {{(pid=116067) load_cells /opt/stack/nova/nova/context.py:464}} Dec 09 01:08:01.877796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:01.879450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:01.880273 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:01.882233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:01.895276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_db.sqlalchemy.engines [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:01.896096 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_db.sqlalchemy.engines [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:02.027981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:02.061388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_db.sqlalchemy.engines [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 01:08:02.370482 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: WARNING keystonemiddleware.auth_token [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:08:02.377811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: WARNING keystonemiddleware.auth_token [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:08:02.404040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: WARNING keystonemiddleware.auth_token [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:08:02.411338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: WARNING keystonemiddleware.auth_token [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:08:02.735207 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: WARNING keystonemiddleware.auth_token [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:08:02.740369 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: WARNING keystonemiddleware.auth_token [None req-d07d04cb-96dd-4cd2-9de7-66fc017939a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:08:02.745704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602a76299c0 pid: 116068 (default app) Dec 09 01:08:02.757053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: WARNING keystonemiddleware.auth_token [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 01:08:02.762225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: WARNING keystonemiddleware.auth_token [None req-a8752211-cd64-4fd1-9f26-d1393a343645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 01:08:02.767625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5602a76299c0 pid: 116067 (default app) Dec 09 01:08:37.177741 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5bc62c44-91cd-4afe-9314-b44c906ecde6 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Action: 'create', calling method: .version_select at 0x7fe61be5d790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1390455058", "metadata": {"Type": "work"}}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:37.179485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5bc62c44-91cd-4afe-9314-b44c906ecde6 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:37.180595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5bc62c44-91cd-4afe-9314-b44c906ecde6 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.231083 Dec 09 01:08:37.181741 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 01:08:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 09 01:08:37.196926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dfd37e76-a62f-4051-af8f-98c5c1e1f045 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Action: 'create', calling method: .version_select at 0x7fe61bdc2310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1773163577", "metadata": {"Type": "work"}}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:37.198856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dfd37e76-a62f-4051-af8f-98c5c1e1f045 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:37.199596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-dfd37e76-a62f-4051-af8f-98c5c1e1f045 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010088 Dec 09 01:08:37.208380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 01:08:37 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 09 01:08:37.214270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-018d3a6b-6e6e-41bf-a731-ff5bfc11af50 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Action: 'create', calling method: .version_select at 0x7fe61be5d820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-44431144", "metadata": {"Type": "work"}}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:37.218975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-018d3a6b-6e6e-41bf-a731-ff5bfc11af50 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:37.219803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-018d3a6b-6e6e-41bf-a731-ff5bfc11af50 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010293 Dec 09 01:08:37.228505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 3/3] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 01:08:37 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 09 01:08:37.234278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d60be85-62fc-40b0-ba01-d4e7d9a2e70e tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Calling method '.version_select at 0x7fe61bdc2dc0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:37.583648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3e1ae4e6-683b-4916-97ac-259b1686f211 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Action: 'create', calling method: .version_select at 0x7fe61be5c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-489433720", "metadata": {"Type": "work"}}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:37.824395 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-8d60be85-62fc-40b0-ba01-d4e7d9a2e70e tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] HTTP exception thrown: Volume tempest-invalid-1732617122 could not be found. Dec 09 01:08:37.826232 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d60be85-62fc-40b0-ba01-d4e7d9a2e70e tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 404 to user: Volume tempest-invalid-1732617122 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:37.827607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8d60be85-62fc-40b0-ba01-d4e7d9a2e70e tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1732617122" status: 404 len: 99 microversion: 2.1 time: 0.598082 Dec 09 01:08:37.828174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 4/4] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Dec 9 01:08:37 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1732617122 => generated 99 bytes in 599 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 09 01:08:37.842572 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a86c6386-f094-4bf4-ad69-374eee407a54 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007017 Dec 09 01:08:37.843111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 5/5] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Dec 9 01:08:37 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 09 01:08:37.864657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d3123c7d-dad8-4a17-9229-8a56cc38c113 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015149 Dec 09 01:08:37.865664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 6/6] 10.222.0.23 () {58 vars in 1136 bytes} [Thu Dec 9 01:08:37 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 09 01:08:37.876593 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ed14461e-5d8f-4ec1-9d3b-47b8afe99273 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Calling method '.version_select at 0x7fe61bd33820>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:38.057501 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-ed14461e-5d8f-4ec1-9d3b-47b8afe99273 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] HTTP exception thrown: Volume 9272761b-65c3-4a70-8d5a-1a1ddf10aa6c could not be found. Dec 09 01:08:38.058095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ed14461e-5d8f-4ec1-9d3b-47b8afe99273 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 404 to user: Volume 9272761b-65c3-4a70-8d5a-1a1ddf10aa6c could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:38.061045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ed14461e-5d8f-4ec1-9d3b-47b8afe99273 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/9272761b-65c3-4a70-8d5a-1a1ddf10aa6c" status: 404 len: 109 microversion: 2.1 time: 0.188983 Dec 09 01:08:38.066841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 7/7] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:08:37 2021] DELETE /compute/v2.1/os-volumes/9272761b-65c3-4a70-8d5a-1a1ddf10aa6c => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:08:38.077290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c9c3be4d-e02b-40a9-93f9-1945b8710947 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Calling method '.version_select at 0x7fe61bd33430>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:38.171505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-c9c3be4d-e02b-40a9-93f9-1945b8710947 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] HTTP exception thrown: Volume 0684ddd3-0917-4abe-acd4-e3ddeae1a082 could not be found. Dec 09 01:08:38.172487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c9c3be4d-e02b-40a9-93f9-1945b8710947 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] Returning 404 to user: Volume 0684ddd3-0917-4abe-acd4-e3ddeae1a082 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:38.173632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c9c3be4d-e02b-40a9-93f9-1945b8710947 tempest-VolumesNegativeTest-117767520 tempest-VolumesNegativeTest-117767520-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/0684ddd3-0917-4abe-acd4-e3ddeae1a082" status: 404 len: 109 microversion: 2.1 time: 0.102975 Dec 09 01:08:38.174278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 8/8] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:38 2021] GET /compute/v2.1/os-volumes/0684ddd3-0917-4abe-acd4-e3ddeae1a082 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:08:38.685325 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3e1ae4e6-683b-4916-97ac-259b1686f211 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.574580 Dec 09 01:08:38.685985 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 1/9] 10.222.0.23 () {60 vars in 1155 bytes} [Thu Dec 9 01:08:36 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2577 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 09 01:08:38.698337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-aabe2553-63e4-44af-aa10-b6cd280d36f8 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61bccf820>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:38.804264 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-aabe2553-63e4-44af-aa10-b6cd280d36f8 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 352 microversion: 2.1 time: 0.110060 Dec 09 01:08:38.804864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 9/10] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:38 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:39.059263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9889a2c1-a857-4a48-8b19-ecbb38cc67ba tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61bcd7160>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:39.147460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9889a2c1-a857-4a48-8b19-ecbb38cc67ba tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1a983123-d4bd-433b-b24f-c0c9be0d2cd9" status: 200 len: 350 microversion: 2.1 time: 0.091820 Dec 09 01:08:39.148027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 10/11] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:39 2021] GET /compute/v2.1/os-volumes/1a983123-d4bd-433b-b24f-c0c9be0d2cd9 => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:08:39.342803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-259983300", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "7517b26d-ae3c-49f6-9f41-580fa4f8c57a"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:39.402402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-426615900", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "2daaacf1-f17f-4c3f-8d5f-6ec019bc5236"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:39.564751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] validate_networks() for [('2daaacf1-f17f-4c3f-8d5f-6ec019bc5236', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:08:39.585303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] validate_networks() for [('7517b26d-ae3c-49f6-9f41-580fa4f8c57a', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:08:41.381542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:08:41.382685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:08:41.383450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:08:41.384216 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:08:41.385728 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:08:41.408977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:41.409781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:41.411058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:41.414188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:41.423433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:08:41.423950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:08:41.424323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:08:41.424737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:08:41.425155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:08:41.452567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:41.453022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:41.461069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:41.471291 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:41.475729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:41.490147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for user 59d2b98f1809405ab307a035062400c2 and project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:41.518854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:08:41.522655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:08:41.557280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Getting quotas for project f744683c3f364dda933c885766c8dfec. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:41.584426 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Getting quotas for user 98b74ad2c40f4a7caf926c7954046137 and project f744683c3f364dda933c885766c8dfec. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:41.610753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:08:41.618711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:08:41.659442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b48c8009-0c85-4680-b226-1f91b021166e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.619444 Dec 09 01:08:41.660788 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 2/12] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:08:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:08:41.666276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-77d18cca-6ecd-4e23-8967-a763420eabc7 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61b3ca040>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:41.786531 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-77d18cca-6ecd-4e23-8967-a763420eabc7 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 353 microversion: 2.1 time: 0.124177 Dec 09 01:08:41.787617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 3/13] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:41 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:41.793115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-485ea491-a825-44ba-8112-a530d01b9155 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61b3cac10>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:41.857430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ea6a0445-ed64-43a4-b1b3-4334449bc6c2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.708270 Dec 09 01:08:41.859967 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 11/14] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:08:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 2711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:08:41.866461 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-40ade2a9-36c1-4398-8a0c-6b2d8fa19150 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:41.878032 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-40ade2a9-36c1-4398-8a0c-6b2d8fa19150 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:41.948933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-485ea491-a825-44ba-8112-a530d01b9155 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a8fc9b7b-4c0d-4aad-99e8-d928f92e50e7" status: 200 len: 351 microversion: 2.1 time: 0.159883 Dec 09 01:08:41.949507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 4/15] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:41 2021] GET /compute/v2.1/os-volumes/a8fc9b7b-4c0d-4aad-99e8-d928f92e50e7 => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:41.961845 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-09aa0505-c037-4492-bdc4-934285616aeb tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61b3ca1f0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:42.034518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-40ade2a9-36c1-4398-8a0c-6b2d8fa19150 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:42.057616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-09aa0505-c037-4492-bdc4-934285616aeb tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 353 microversion: 2.1 time: 0.106717 Dec 09 01:08:42.058217 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 5/16] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:41 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:42.063390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2087a120-88b6-42bd-8217-60931f66fb5a tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:42.065911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2087a120-88b6-42bd-8217-60931f66fb5a tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:42.074065 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-40ade2a9-36c1-4398-8a0c-6b2d8fa19150 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1217 microversion: 2.1 time: 0.211411 Dec 09 01:08:42.095490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 12/17] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:41 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:42.106033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ca992070-6e4d-4de2-94de-3637ec5ab229 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61b3ee040>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:42.279254 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ca992070-6e4d-4de2-94de-3637ec5ab229 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 202 len: 0 microversion: 2.1 time: 0.182444 Dec 09 01:08:42.279827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 13/18] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:08:42 2021] DELETE /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:08:42.289753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c7a4e266-073a-4d20-bb53-eb5d00d7ff36 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61bccfd30>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:42.314239 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2087a120-88b6-42bd-8217-60931f66fb5a tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:42.332645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2087a120-88b6-42bd-8217-60931f66fb5a tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1214 microversion: 2.1 time: 0.273018 Dec 09 01:08:42.333232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 6/19] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:42 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:42.507172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c7a4e266-073a-4d20-bb53-eb5d00d7ff36 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 352 microversion: 2.1 time: 0.222783 Dec 09 01:08:42.508103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 14/20] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:42 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 352 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:43.103010 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c7474ea3-b27c-4b7d-aae3-20c18e7d3fd6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:43.105300 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c7474ea3-b27c-4b7d-aae3-20c18e7d3fd6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:43.292939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c7474ea3-b27c-4b7d-aae3-20c18e7d3fd6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:43.299665 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c7474ea3-b27c-4b7d-aae3-20c18e7d3fd6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1217 microversion: 2.1 time: 0.200794 Dec 09 01:08:43.315952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 7/21] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:43 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:43.351868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-db048125-711d-4209-beb0-24083e1aca8d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:43.352817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-db048125-711d-4209-beb0-24083e1aca8d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:43.440684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-db048125-711d-4209-beb0-24083e1aca8d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:43.448714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-db048125-711d-4209-beb0-24083e1aca8d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1214 microversion: 2.1 time: 0.102172 Dec 09 01:08:43.450660 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 15/22] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:43 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:43.526077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3929280f-dad9-48c9-9c05-9155b89d1aea tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61b3f5940>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:43.661953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3929280f-dad9-48c9-9c05-9155b89d1aea tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 352 microversion: 2.1 time: 0.145861 Dec 09 01:08:43.663195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 8/23] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:43 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:44.322236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:44.323480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:44.346567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:44.347910 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:44.351901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:44.352624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:44.467994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:44.469361 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:44.480832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:44.483936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:44.484938 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:44.488570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:44.740115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:44.768445 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-99068dcb-b431-473a-9184-e14ddb1f88a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1221 microversion: 2.1 time: 0.448104 Dec 09 01:08:44.769696 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 16/24] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:44 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1221 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:44.781251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:44.791918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-432e5a87-afb3-47b6-b603-efd99a1d01a8 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61ab70dc0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:44.873291 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-56d93fe3-62a7-4cdb-9478-8c013e0581ee tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1218 microversion: 2.1 time: 0.408341 Dec 09 01:08:44.890207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 9/25] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:44 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1218 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:45.205325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-432e5a87-afb3-47b6-b603-efd99a1d01a8 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 200 len: 352 microversion: 2.1 time: 0.433582 Dec 09 01:08:45.211750 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 17/26] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:44 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 352 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:45.791180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:45.792500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:45.811771 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:45.812234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:45.819489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:45.820202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:45.997405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:46.015082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-19acec7a-c9be-4ade-b03d-dc9820b5e566 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1213 microversion: 2.1 time: 0.224958 Dec 09 01:08:46.015290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 10/27] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:45 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:46.039815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:46.040474 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:46.085035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:46.086881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:46.092362 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:46.093811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1958096743", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a68f2a4-8fff-4849-9bdf-516da1fd3fcd"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:46.095353 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:46.192190 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] validate_networks() for [('1a68f2a4-8fff-4849-9bdf-516da1fd3fcd', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:08:46.559625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:46.575548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7dd519fd-f9e8-4d7d-811e-29bb0883c3d6 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1274 microversion: 2.1 time: 0.556767 Dec 09 01:08:46.576549 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 11/28] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:46 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1274 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:46.581339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5b75a04b-ce09-43ef-bf3b-d0074a6f7b04 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61ab78ca0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:46.710015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5b75a04b-ce09-43ef-bf3b-d0074a6f7b04 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b96e6eba-14a7-4936-8278-a5a54b505451" status: 200 len: 350 microversion: 2.1 time: 0.131990 Dec 09 01:08:46.715559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 12/29] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:46 2021] GET /compute/v2.1/os-volumes/b96e6eba-14a7-4936-8278-a5a54b505451 => generated 350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:46.729332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-757585cc-b783-47ae-b719-bcec4fe4d3f2 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Calling method '.version_select at 0x7fe61b3e8700>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:46.800243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-757585cc-b783-47ae-b719-bcec4fe4d3f2 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] HTTP exception thrown: Volume 4f712023-7977-4bc4-be33-a58a6861a155 could not be found. Dec 09 01:08:46.801649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-757585cc-b783-47ae-b719-bcec4fe4d3f2 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] Returning 404 to user: Volume 4f712023-7977-4bc4-be33-a58a6861a155 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:08:46.802698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-757585cc-b783-47ae-b719-bcec4fe4d3f2 tempest-VolumesGetTestJSON-2144221151 tempest-VolumesGetTestJSON-2144221151-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155" status: 404 len: 109 microversion: 2.1 time: 0.085948 Dec 09 01:08:46.803888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 13/30] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:08:46 2021] GET /compute/v2.1/os-volumes/4f712023-7977-4bc4-be33-a58a6861a155 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:08:46.808528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c5375d07-13a1-4cf5-b1ac-e334f53b0729 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61ab415e0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:47.043500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c5375d07-13a1-4cf5-b1ac-e334f53b0729 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.238132 Dec 09 01:08:47.044153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 14/31] 10.222.0.23 () {58 vars in 1133 bytes} [Thu Dec 9 01:08:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:47.048826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:47.049645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:47.072832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:47.073296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:47.086626 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:47.087311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:47.637878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:47.653593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b3997cca-d3ea-4ed8-a21f-7a5aed57933a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1275 microversion: 2.1 time: 0.607403 Dec 09 01:08:47.655040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:47 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1275 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:47.671439 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9288fb52-ce86-475d-9b1d-6cd827a04622 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61ab41ca0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:47.919711 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9288fb52-ce86-475d-9b1d-6cd827a04622 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.257339 Dec 09 01:08:47.921427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1148 bytes} [Thu Dec 9 01:08:47 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:47.928459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:47.929256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:47.946450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:47.946981 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:47.948958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:47.949408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:48.103698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:08:48.104480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:08:48.105096 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:08:48.105584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:08:48.106692 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:08:48.117688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:48.118482 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:48.127483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:48.128577 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:48.160020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Getting quotas for project f142a63d748e48d08bff8bfeeb533566. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:48.180578 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Getting quotas for user d5ff623eda804e5980eee894d43cdc2e and project f142a63d748e48d08bff8bfeeb533566. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:48.210830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:08:48.214100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:08:48.441490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a538c52e-433b-4f72-8166-5d36f8eb1e67 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.635326 Dec 09 01:08:48.454297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 18/34] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:08:45 2021] POST /compute/v2.1/servers => generated 383 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:08:48.477325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a4866174-801e-4dad-97de-775e70edbcbf tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61ab70a60>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:48.665850 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:48.682247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9c02a752-401b-4806-9cc1-64b6a890e462 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1272 microversion: 2.1 time: 0.759504 Dec 09 01:08:48.689002 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:47 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1272 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:48.711667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-57972eb8-4ef7-4e99-ba6a-e77c8c5403c2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:48.712338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-57972eb8-4ef7-4e99-ba6a-e77c8c5403c2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:48.810241 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a4866174-801e-4dad-97de-775e70edbcbf tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.351061 Dec 09 01:08:48.836879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1133 bytes} [Thu Dec 9 01:08:48 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:48.857253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:48.862620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:48.888694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:48.892591 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:48.896734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:48.901534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:48.971197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-57972eb8-4ef7-4e99-ba6a-e77c8c5403c2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:48.983907 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-57972eb8-4ef7-4e99-ba6a-e77c8c5403c2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1222 microversion: 2.1 time: 0.292361 Dec 09 01:08:48.999805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:48 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:49.016105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4c5adcb4-4778-47b1-b286-14b53a9f7ada tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61aad34c0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:49.122683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:49.160832 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9a841c49-32af-478a-a239-a43cf1499830 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1275 microversion: 2.1 time: 0.317671 Dec 09 01:08:49.163858 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:48 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:49.308154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4c5adcb4-4778-47b1-b286-14b53a9f7ada tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.306745 Dec 09 01:08:49.308722 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 19/39] 10.222.0.23 () {58 vars in 1166 bytes} [Thu Dec 9 01:08:48 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:49.325259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e32070b9-6710-44e9-a8bc-f4ecb33ea00c tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61ab2c430>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:49.401533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-499061165", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a68f2a4-8fff-4849-9bdf-516da1fd3fcd"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:49.553475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] validate_networks() for [('1a68f2a4-8fff-4849-9bdf-516da1fd3fcd', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:08:49.627416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e32070b9-6710-44e9-a8bc-f4ecb33ea00c tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.308018 Dec 09 01:08:49.636327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1169 bytes} [Thu Dec 9 01:08:49 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:49.641805 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b3dd1347-e751-4b98-aad0-91a35d0449ac tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61aaccee0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:50.005081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b3dd1347-e751-4b98-aad0-91a35d0449ac tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.367369 Dec 09 01:08:50.014120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Dec 9 01:08:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:50.020064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:50.020877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:50.039544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:50.040440 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:50.043947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:50.044812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:51.224691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:51.257352 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-17a798f8-78ef-4ad3-8081-7ecd92ff6dd2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 1.241590 Dec 09 01:08:51.260331 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:50 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:51.278182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b04507c6-7fea-4fce-93fa-8ab1fef73121 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61aaccaf0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:51.581068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b04507c6-7fea-4fce-93fa-8ab1fef73121 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317852 Dec 09 01:08:51.581644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 24/43] 10.222.0.23 () {58 vars in 1187 bytes} [Thu Dec 9 01:08:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:51.586386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:51.587202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:51.601162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:51.607111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:51.612928 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:51.613576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:52.393008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:52.405747 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-55df4b29-dce8-4a4e-a996-7c42481896d4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1275 microversion: 2.1 time: 0.821715 Dec 09 01:08:52.411965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 25/44] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:51 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1275 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:52.441397 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-242e6c96-1d10-4a4f-950c-94f4efe260c2 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] Calling method '.version_select at 0x7fe61b3ee550>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:52.747895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-242e6c96-1d10-4a4f-950c-94f4efe260c2 tempest-VolumesTestJSON-1203903841 tempest-VolumesTestJSON-1203903841-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.333724 Dec 09 01:08:52.748723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 26/45] 10.222.0.23 () {58 vars in 1154 bytes} [Thu Dec 9 01:08:52 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:52.752988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:52.753609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:52.791984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:52.792926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:52.793793 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:52.794240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:53.906612 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:08:53.907246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:08:53.907660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:08:53.908459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:08:53.909404 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:08:53.930088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:53.931290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:53.932682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:53.933370 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:53.956690 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Getting quotas for project f142a63d748e48d08bff8bfeeb533566. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:53.962765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Getting quotas for user d5ff623eda804e5980eee894d43cdc2e and project f142a63d748e48d08bff8bfeeb533566. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:53.980930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:08:53.983506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:08:54.044350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a7231cbf-9104-43b5-9829-552bf9255ae6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.652819 Dec 09 01:08:54.046353 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 20/46] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:08:49 2021] POST /compute/v2.1/servers => generated 383 bytes in 4660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:08:54.258279 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:54.267439 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e07a9f12-fde9-481d-ad55-281678aa4c63 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 1.517697 Dec 09 01:08:54.269991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 27/47] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:52 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:54.281262 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:54.282344 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:54.301113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:54.303046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:54.304113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:54.307230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:54.396651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: .version_select at 0x7fe61aaeb4c0>, body: {"keypair": {"name": "tempest-keypair-956893353"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:54.459609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:54.472082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:54.814094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:08:54.860682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:08:54.926948 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-93509ee7-91f0-4919-8778-2947d5b98061 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.878960 Dec 09 01:08:54.930264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 21/48] 10.222.0.23 () {60 vars in 1157 bytes} [Thu Dec 9 01:08:54 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:54.940017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:54.951251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3b0a3815-5edb-4b7d-ba4e-194890503848 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:54.955984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3b0a3815-5edb-4b7d-ba4e-194890503848 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:54.960940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-818654d6-d4ca-4781-a103-e42a47bf8cca tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.689638 Dec 09 01:08:54.961511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 28/49] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:54 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:55.200044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-593db70b-5c26-41ce-8f9c-a8bf3870e8fa req-eac3ea34-e704-4b71-b96a-cb70f4d66261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd973508-e7e7-40a7-8166-8690649e69a4", "tag": "a87c89e2-1888-4b5a-82fd-824571febafc"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:55.203322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:08:55.203322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:08:55.231092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-593db70b-5c26-41ce-8f9c-a8bf3870e8fa req-eac3ea34-e704-4b71-b96a-cb70f4d66261 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.239915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-593db70b-5c26-41ce-8f9c-a8bf3870e8fa req-eac3ea34-e704-4b71-b96a-cb70f4d66261 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.311431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-593db70b-5c26-41ce-8f9c-a8bf3870e8fa req-eac3ea34-e704-4b71-b96a-cb70f4d66261 service nova] Creating event network-changed:a87c89e2-1888-4b5a-82fd-824571febafc for instance cd973508-e7e7-40a7-8166-8690649e69a4 on hv-cinder-79053 Dec 09 01:08:55.311431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-593db70b-5c26-41ce-8f9c-a8bf3870e8fa req-eac3ea34-e704-4b71-b96a-cb70f4d66261 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 09 01:08:55.312573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.313015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.324612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.325077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.354682 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.compute.rpcapi [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 09 01:08:55.357986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] Releasing lock "compute-rpcapi-router" {{(pid=116068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 09 01:08:55.369054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3b0a3815-5edb-4b7d-ba4e-194890503848 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:55.382041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3b0a3815-5edb-4b7d-ba4e-194890503848 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1221 microversion: 2.1 time: 0.449630 Dec 09 01:08:55.388599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 22/50] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:54 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1221 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:55.416818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:55.420862 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:55.474967 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.475701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.477422 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.479137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.504699 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b4c971ad-d612-4c10-bf65-5f25b3be5318 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.541939 Dec 09 01:08:55.505889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 29/51] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:08:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:55.979007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:55.980064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:55.995150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.995677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:55.996992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:55.997738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:56.914787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:56.925024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-88487580-f838-49d6-8ead-70c08fb2134c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 1.534141 Dec 09 01:08:56.930211 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 23/52] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:55 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:56.939677 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:56.942796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:56.960630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:56.962050 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:56.964564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:56.969871 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:57.110247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:57.123931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c403ed1e-6d27-4508-9c42-7d73737a7f4a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1281 microversion: 2.1 time: 0.190178 Dec 09 01:08:57.124556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 24/53] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:56 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1281 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:57.207098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:57.218235 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f229cdff-e936-4812-899e-8a0cba8715b9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 1.242047 Dec 09 01:08:57.220285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 30/54] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:55 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:57.953520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:57.954065 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:57.968311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:57.968803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:57.969668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:57.970142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:58.142629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:58.143257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:58.154769 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:58.155231 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:58.156051 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:58.156520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:58.508183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:58.534310 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c18ae3be-b915-4321-beff-20541b19d666 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1281 microversion: 2.1 time: 0.392946 Dec 09 01:08:58.572394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 31/55] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:58 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1281 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:08:58.588781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:58.597734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:58.630623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:58.631050 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:58.636310 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:58.640874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.063751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:59.073746 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-acaea43d-ec02-4b43-90e9-d313daa4df2f tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 1.129914 Dec 09 01:08:59.078511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 25/56] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:57 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:59.473154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-49089cff-acbd-42e7-be4b-a80d590fcfb0 req-eee636e7-4164-40ab-a3b9-24f9da1a5180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b888f-f816-49a9-ad1b-5aec93ff2873", "tag": "45951bb1-90b0-42b8-aa49-f5040ab0860b"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:08:59.476233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:08:59.476233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:08:59.488611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-49089cff-acbd-42e7-be4b-a80d590fcfb0 req-eee636e7-4164-40ab-a3b9-24f9da1a5180 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:59.489770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-49089cff-acbd-42e7-be4b-a80d590fcfb0 req-eee636e7-4164-40ab-a3b9-24f9da1a5180 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.533487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-49089cff-acbd-42e7-be4b-a80d590fcfb0 req-eee636e7-4164-40ab-a3b9-24f9da1a5180 service nova] Creating event network-changed:45951bb1-90b0-42b8-aa49-f5040ab0860b for instance 3d2b888f-f816-49a9-ad1b-5aec93ff2873 on hv-cinder-79053 Dec 09 01:08:59.534444 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-49089cff-acbd-42e7-be4b-a80d590fcfb0 req-eee636e7-4164-40ab-a3b9-24f9da1a5180 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 09 01:08:59.537672 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:59.538888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.541552 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:59.544328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.566994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.compute.rpcapi [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 09 01:08:59.569850 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] Releasing lock "compute-rpcapi-router" {{(pid=116067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 09 01:08:59.632480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-825cb0d8-7898-40a9-b83b-c641f23bd551 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546391 Dec 09 01:08:59.633457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 26/57] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:08:59.639233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:08:59.640589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:08:59.657581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:59.658224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.659197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:08:59.659708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:08:59.839357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:59.861714 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-03fca594-aa58-42d5-a39b-76a10370b832 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1279 microversion: 2.1 time: 0.226804 Dec 09 01:08:59.862273 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 27/58] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:59 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:08:59.893687 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:08:59.901737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d89955fa-a207-4ec3-b906-b184285dea51 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 1.323802 Dec 09 01:08:59.904631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 32/59] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:08:58 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:00.095357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:00.096998 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:00.107099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.109560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:00.112696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.113940 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:00.685463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:00.694302 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a685a1d1-8af7-477a-aaad-32117dacabc7 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.603493 Dec 09 01:09:00.695138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 28/60] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:00 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:00.900117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:00.901283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:00.921275 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:00.921897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:00.926691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.927199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:00.928034 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.928480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:00.929263 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.929724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:00.930554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:00.956347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:01.442933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:01.450568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ab986da0-e18c-4f5e-bac6-58e8a03a3b15 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1279 microversion: 2.1 time: 0.565262 Dec 09 01:09:01.459620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 33/61] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:00 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1279 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:01.711103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:01.711719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:01.719111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:01.719590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:01.726124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:01.726721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:01.987572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:02.002795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7b54b304-61f6-4734-abc2-38cc94f925a7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 1.085433 Dec 09 01:09:02.003710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 29/62] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:00 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:02.158333 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-09f8a9c9-cc82-4cbc-a66c-0692102c40ea req-ede0d272-5269-464b-9bea-149e71ddd691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49e39a7-1ec1-4033-ae68-8088625993b3", "tag": "1576c59c-6b4a-44f7-a7f1-368b59dcd4ff"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:02.167589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:02.167589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:02.187644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-09f8a9c9-cc82-4cbc-a66c-0692102c40ea req-ede0d272-5269-464b-9bea-149e71ddd691 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:02.188519 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-09f8a9c9-cc82-4cbc-a66c-0692102c40ea req-ede0d272-5269-464b-9bea-149e71ddd691 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:02.215541 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-09f8a9c9-cc82-4cbc-a66c-0692102c40ea req-ede0d272-5269-464b-9bea-149e71ddd691 service nova] Creating event network-changed:1576c59c-6b4a-44f7-a7f1-368b59dcd4ff for instance d49e39a7-1ec1-4033-ae68-8088625993b3 on hv-cinder-79053 Dec 09 01:09:02.227853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-09f8a9c9-cc82-4cbc-a66c-0692102c40ea req-ede0d272-5269-464b-9bea-149e71ddd691 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076280 Dec 09 01:09:02.228952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 30/63] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:02.232869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:02.246057 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-852c8178-7514-4c9f-869e-4076dc5ec958 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.537414 Dec 09 01:09:02.247370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:01 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:02.478312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:02.480044 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:02.493989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:02.495067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:02.498838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:02.500458 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:02.562961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1850101440", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b0a9c8-a9f0-4971-a73a-1b8741a01fce"}], "security_groups": [{"name": "tempest-securitygroup--1166624108"}], "key_name": "tempest-keypair-956893353", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:02.660017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:02.669015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-60c719b3-7083-4801-a9b9-74c68f98e401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1279 microversion: 2.1 time: 0.195989 Dec 09 01:09:02.676258 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 31/65] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:02 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:02.774131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] validate_networks() for [('56b0a9c8-a9f0-4971-a73a-1b8741a01fce', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:09:03.022162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:03.023543 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:03.043608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:03.044937 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:03.048713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:03.053135 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:03.548825 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:03.556443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ab697634-9a0d-45f8-acd7-89ddeef2f9e1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.539022 Dec 09 01:09:03.568810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:03 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:03.578055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:03.583091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:03.600449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:03.601856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:03.604446 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:03.609523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.078668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:04.085817 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5b6e590e-3811-4336-89ea-9c2a3d839c32 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.515474 Dec 09 01:09:04.086408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 33/67] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:03 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:04.098605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:04.099222 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:04.116373 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.117812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.119276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.122769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.159517 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:09:04.164586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:09:04.165035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:09:04.165700 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:09:04.166307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:09:04.185584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.189278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.190387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.193500 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.239639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:09:04.260826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:09:04.283688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:09:04.287313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:09:04.347450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:04.355827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e55e1ae3-c92a-4846-9d47-fecaa6d9c71e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.261026 Dec 09 01:09:04.367372 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 34/68] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:04 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:04.385914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8a2c8757-b471-4a42-bec4-6f8566955798 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.828316 Dec 09 01:09:04.387736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 35/69] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:09:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 09 01:09:04.399434 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4b7cf964-1098-42d5-919e-04104e847588 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:04.400053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4b7cf964-1098-42d5-919e-04104e847588 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:04.513559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4b7cf964-1098-42d5-919e-04104e847588 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:04.528111 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4b7cf964-1098-42d5-919e-04104e847588 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1237 microversion: 2.1 time: 0.132952 Dec 09 01:09:04.539069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:04 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1237 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:04.585239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:04.585740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:04.598147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.598823 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.599565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.600150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.751711 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-5adc0d2c-b6d3-41e8-83aa-a82b4d3d1bd1 req-a35111fc-ce5d-4268-8af4-915ce1d92683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4617dfc6-89b9-4d31-b4bc-9c150258059d", "tag": "8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:04.753528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:04.753528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:04.770544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-5adc0d2c-b6d3-41e8-83aa-a82b4d3d1bd1 req-a35111fc-ce5d-4268-8af4-915ce1d92683 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:04.771234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-5adc0d2c-b6d3-41e8-83aa-a82b4d3d1bd1 req-a35111fc-ce5d-4268-8af4-915ce1d92683 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:04.807150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-5adc0d2c-b6d3-41e8-83aa-a82b4d3d1bd1 req-a35111fc-ce5d-4268-8af4-915ce1d92683 service nova] Creating event network-changed:8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb for instance 4617dfc6-89b9-4d31-b4bc-9c150258059d on hv-cinder-79053 Dec 09 01:09:04.812767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-5adc0d2c-b6d3-41e8-83aa-a82b4d3d1bd1 req-a35111fc-ce5d-4268-8af4-915ce1d92683 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065156 Dec 09 01:09:04.816893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 36/71] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:04.863386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:04.875403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a1dd1bb2-e94f-48b7-a629-a5abb71470d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.294068 Dec 09 01:09:04.876282 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 36/72] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:04 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:05.103456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:05.104181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:05.123520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.125042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.133001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.135391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.381780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:05.384126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:05.384795 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:05.393885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0774d1d0-cc80-4169-b8f8-8cbb61133494 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.293547 Dec 09 01:09:05.398396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 37/73] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:05 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:05.404836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.408159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.410174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.413509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.545502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:05.546268 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:05.555827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.558392 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.559401 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.560101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.702062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:05.713319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-100c836c-73dc-4846-aa10-cfe3b66bafda tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1289 microversion: 2.1 time: 0.171829 Dec 09 01:09:05.717107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 38/74] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:05 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1289 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:05.800153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:05.814574 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c3628b0b-3d10-48ff-8330-40a60e2bca62 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.431486 Dec 09 01:09:05.815422 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:05 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:05.894065 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:05.895086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:05.905272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.905917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:05.907026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:05.907630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.180824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:06.188830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cabe595b-d0b3-4894-a273-397090d28c9c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.300135 Dec 09 01:09:06.189744 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 39/76] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:05 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:06.410317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:06.411154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:06.418021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.418892 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.419853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.420303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.590252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:06.598507 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-05ec1828-8bb7-4f21-b731-d1175cba0d4c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.191647 Dec 09 01:09:06.598972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 38/77] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:06 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:06.733553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:06.734083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:06.739962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.740407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.741176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.741605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.800427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:06.807495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-11a79817-21e5-488f-a15c-24fe51bd9e18 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1295 microversion: 2.1 time: 0.078400 Dec 09 01:09:06.808049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:06 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1295 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:06.831242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:06.831848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:06.837710 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.838161 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.838985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:06.839448 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:06.966705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:06.974504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b15d879b-51cb-4d21-b311-288228d5a810 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.146781 Dec 09 01:09:06.975073 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:06 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:07.205064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:07.205669 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:07.211499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.211939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.212699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.213137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.344282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:07.351632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-52fe50e5-2e66-4c4e-96eb-c6469e861c3b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.150177 Dec 09 01:09:07.352183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 41/80] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:07 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:07.616218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:07.616832 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:07.623637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.624093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.624873 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.625308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.764379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:07.772114 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-344e460a-9161-4921-829a-72b6c3a18820 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.159765 Dec 09 01:09:07.772681 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 40/81] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:07 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:07.824980 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:07.825617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:07.831309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.831760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.832565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:07.833183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:07.897313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:07.905174 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-399969e2-f903-4526-b599-0b9af8eff290 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1295 microversion: 2.1 time: 0.084078 Dec 09 01:09:07.905737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 42/82] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:07 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:07.992675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:07.994554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:08.001485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.002021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.002870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.003306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.138471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:08.144816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6331617e-72ea-406f-ba3a-484f091e209e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.156983 Dec 09 01:09:08.145365 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:07 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:08.368473 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:08.369006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:08.374835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.375276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.376038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.376471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.504830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:08.512622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9f506880-0b4e-4c2a-b8d7-1e81f8dd4197 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.147835 Dec 09 01:09:08.513185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:08 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:08.788010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:08.788707 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:08.794602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.795042 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.795806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.796257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.921013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:08.921534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:08.927260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.927401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:08.927708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.928491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:08.928925 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:08.936676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2ff0315d-5152-455d-8170-283c3f383f5b tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.152231 Dec 09 01:09:08.937555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:08 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:09.022001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:09.029551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-57d33614-8862-4320-a142-9d92aa140a97 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1295 microversion: 2.1 time: 0.112391 Dec 09 01:09:09.030466 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:08 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:09.163096 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:09.163767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:09.174186 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.176221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:09.176221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.176401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:09.349246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:09.361132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3415107d-ff16-4544-a632-0725f1756eb3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.203132 Dec 09 01:09:09.362396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:09 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:09.529255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:09.530488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:09.536951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.537752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:09.540347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.541320 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:09.750667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:09.762493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dd8639e6-81ab-44b8-b870-6ee620bef3c1 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.237108 Dec 09 01:09:09.767826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:09 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:09.954464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:09.955111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:09.963765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.964217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:09.968275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:09.968796 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.047555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:10.048167 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:10.054355 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.055448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.056539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.057442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.171823 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:10.179092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4d181d52-73e9-416b-831e-f040c07888c9 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.228508 Dec 09 01:09:10.179979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 44/89] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:09 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:10.266244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:10.273563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-555d3541-9518-493d-8c69-7fa954f26d1e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.230461 Dec 09 01:09:10.283421 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 46/90] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:10 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:10.378225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:10.379894 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:10.387620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.388684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.390933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.392082 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.546252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:10.554545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cd50a481-3a1f-4b08-8560-724bc2ba680f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.179876 Dec 09 01:09:10.555117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 45/91] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:10 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:10.779364 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:10.780014 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:10.786157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.786986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.787779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:10.788212 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:10.933769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:10.941424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-68bf3ba5-bf05-451e-b67f-0ca41e00e0a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.166519 Dec 09 01:09:10.941992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 47/92] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:10 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:11.196059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:11.196677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:11.203624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.204084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.204869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.205312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.290348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:11.291099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:11.298139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.298633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.299420 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.299859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.336353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:11.343824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8e18a28a-5f33-4bd7-8c08-1cbf235c6272 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.151420 Dec 09 01:09:11.344504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 46/93] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:11 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:11.441186 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:11.448458 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9fd40067-b88a-4ecc-97fd-824e2b343533 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.161708 Dec 09 01:09:11.449846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 48/94] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:11 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:11.612116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:11.613366 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:11.619976 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.621127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.621993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.622661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.765750 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:11.774550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e49bcec6-439b-47c6-87b2-3d084deafea4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.166353 Dec 09 01:09:11.784175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:11 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:11.958589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:11.959201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:11.965235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.965685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:11.966502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:11.966941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.099713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:12.107115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e29a9df9-76c7-45c5-8624-d0aee1f26bf4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.152084 Dec 09 01:09:12.107684 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 49/96] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:11 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:12.361647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:12.362335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:12.368314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.368877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.369753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.370473 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.467261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:12.468788 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:12.481043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.482404 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.483563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.484213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.540261 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:12.552837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-57a1e4d9-3238-4892-b0ec-d44c2361f896 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.194994 Dec 09 01:09:12.554015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 48/97] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:12 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:12.630521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:12.640211 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-41d34ee5-5799-4ac5-80d3-0e3131956d82 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.178402 Dec 09 01:09:12.651217 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 50/98] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:12 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:12.791689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:12.792268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:12.799778 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.800239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:12.801033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:12.801472 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.020930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:13.029913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fc70c1ad-1c2e-49db-b13e-a43f2af176bf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.242157 Dec 09 01:09:13.030648 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:12 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:13.064418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-01b31822-2a32-4221-be2f-0a9ac16473b1 req-f5778f3a-022e-498b-be5f-ea85f00b4f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11e7d82-d6f0-4625-980e-40d38e06de06", "tag": "bf23067c-8af4-4fb6-9414-19f6cd332b66"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:13.067994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:13.067994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:13.080483 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-01b31822-2a32-4221-be2f-0a9ac16473b1 req-f5778f3a-022e-498b-be5f-ea85f00b4f3b service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.081242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-01b31822-2a32-4221-be2f-0a9ac16473b1 req-f5778f3a-022e-498b-be5f-ea85f00b4f3b service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.101905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-01b31822-2a32-4221-be2f-0a9ac16473b1 req-f5778f3a-022e-498b-be5f-ea85f00b4f3b service nova] Creating event network-changed:bf23067c-8af4-4fb6-9414-19f6cd332b66 for instance b11e7d82-d6f0-4625-980e-40d38e06de06 on hv-cinder-79053 Dec 09 01:09:13.107349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-01b31822-2a32-4221-be2f-0a9ac16473b1 req-f5778f3a-022e-498b-be5f-ea85f00b4f3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049274 Dec 09 01:09:13.109511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 51/100] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:13.126345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:13.127067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:13.133491 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.133963 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.134754 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.135241 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.318923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:13.329474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3195894e-94e3-409b-92a0-19a2c3a44adb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.209790 Dec 09 01:09:13.331280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:13 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:13.570803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:13.571388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:13.579090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.579652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.580453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.580898 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.656757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:13.657448 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:13.667189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.668168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.668988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:13.669571 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:13.727887 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:13.744577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-15a78245-b6b2-4131-81e5-c13785bed789 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.178146 Dec 09 01:09:13.746293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 52/102] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:13 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:13.858590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:13.878760 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fcb90b0d-ff00-4115-80ee-d0115735eb30 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.225021 Dec 09 01:09:13.879478 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 51/103] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:13 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:14.052191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:14.053070 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:14.060059 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.060736 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.061726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.062868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.266236 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:14.274538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2f3e96f0-e396-4d8e-adb3-48ea9e0789f6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.226625 Dec 09 01:09:14.275183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 53/104] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:14 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:14.348115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:14.348886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:14.355642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.356439 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.357516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.357968 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.584233 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:14.594793 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-31ab73d1-3e23-4243-9772-0695a08a345c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.250632 Dec 09 01:09:14.607380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 52/105] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:14 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:14.760992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:14.762328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:14.768613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.769267 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.771185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.771952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.900304 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:14.902110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:14.916203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.916724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.918770 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:14.919255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:14.953427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:14.960984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-86f1ea65-03a2-47b5-ac71-216517c04bb3 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.203925 Dec 09 01:09:14.961592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 54/106] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:14 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:15.244821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-250b508d-6eb4-4596-adc1-e7012cd5a839 req-33e1fa1b-f125-4a67-ba24-005c61ad401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b888f-f816-49a9-ad1b-5aec93ff2873", "name": "network-vif-plugged", "status": "completed", "tag": "45951bb1-90b0-42b8-aa49-f5040ab0860b"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:15.246854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:15.246854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:15.262082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-250b508d-6eb4-4596-adc1-e7012cd5a839 req-33e1fa1b-f125-4a67-ba24-005c61ad401c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:15.262824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-250b508d-6eb4-4596-adc1-e7012cd5a839 req-33e1fa1b-f125-4a67-ba24-005c61ad401c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:15.285056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-250b508d-6eb4-4596-adc1-e7012cd5a839 req-33e1fa1b-f125-4a67-ba24-005c61ad401c service nova] Creating event network-vif-plugged:45951bb1-90b0-42b8-aa49-f5040ab0860b for instance 3d2b888f-f816-49a9-ad1b-5aec93ff2873 on hv-cinder-79053 Dec 09 01:09:15.298321 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-250b508d-6eb4-4596-adc1-e7012cd5a839 req-33e1fa1b-f125-4a67-ba24-005c61ad401c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182133 Dec 09 01:09:15.299154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 55/107] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:09:15.313603 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:15.314595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:15.321125 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:15.321900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:15.322948 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:15.324305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:15.423208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:15.438061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e449960b-82b9-41e4-9a7e-659ed38db7a3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.543819 Dec 09 01:09:15.439374 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 53/108] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:14 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:15.614218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:15.615108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:15.628105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:15.632735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:15.634572 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:15.640275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:15.688931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:15.700068 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c998df23-ec00-4210-b7a3-8f1a74e15aa8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.399843 Dec 09 01:09:15.702776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:15 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:15.921614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:15.931697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3603457c-2224-4c65-a640-b49906cfc4e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.322361 Dec 09 01:09:15.934166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 54/110] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:15 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:15.979565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:15.981224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:16.013786 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.014579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.015575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.016037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.273767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:16.284112 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ddb7f31d-c4b9-4493-94b6-f1fc914272e2 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.308885 Dec 09 01:09:16.284989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 57/111] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:15 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:16.458250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:16.459452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:16.468997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.469606 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.470762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.471748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.684348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:16.694950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e1826dab-314c-4099-9e4d-75a017d3d643 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.242444 Dec 09 01:09:16.696356 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 55/112] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:16 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:16.720484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:16.722147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:16.730708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.731301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.732517 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.733724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.929965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:16.947806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d2ae88fd-a5ae-4b05-93b9-fa5adbabc9fd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.231506 Dec 09 01:09:16.949104 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:16 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:16.955577 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:16.956197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:16.967890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.968400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:16.969486 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:16.970078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.180821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:17.190669 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0bbc00f2-5666-4202-868a-708c8d67c5c9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.244937 Dec 09 01:09:17.191474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:16 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:17.302285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:17.304219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:17.313107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.313936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.315025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.315707 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.450394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd973508-e7e7-40a7-8166-8690649e69a4", "name": "network-vif-plugged", "status": "completed", "tag": "a87c89e2-1888-4b5a-82fd-824571febafc"}, {"server_uuid": "d49e39a7-1ec1-4033-ae68-8088625993b3", "name": "network-vif-plugged", "status": "completed", "tag": "1576c59c-6b4a-44f7-a7f1-368b59dcd4ff"}, {"server_uuid": "4617dfc6-89b9-4d31-b4bc-9c150258059d", "name": "network-vif-plugged", "status": "completed", "tag": "8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:17.453806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:17.453806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:09:17.475550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.477627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.505356 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Creating event network-vif-plugged:a87c89e2-1888-4b5a-82fd-824571febafc for instance cd973508-e7e7-40a7-8166-8690649e69a4 on hv-cinder-79053 Dec 09 01:09:17.506134 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Creating event network-vif-plugged:1576c59c-6b4a-44f7-a7f1-368b59dcd4ff for instance d49e39a7-1ec1-4033-ae68-8088625993b3 on hv-cinder-79053 Dec 09 01:09:17.506947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] Creating event network-vif-plugged:8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb for instance 4617dfc6-89b9-4d31-b4bc-9c150258059d on hv-cinder-79053 Dec 09 01:09:17.530169 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-a6b90a4b-7c3e-4019-a77d-f0c926ec2ba3 req-1624b066-1b16-439e-8783-df7303dbd154 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087257 Dec 09 01:09:17.531216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 57/115] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:17 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:09:17.567888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:17.582137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-48d6fcab-71c1-4b28-aeb8-212a66c73dce tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.283826 Dec 09 01:09:17.583683 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 59/116] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:17 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:17.712466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:17.713536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:17.721837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.722705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.723721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.724360 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.884237 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:17.892769 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-84c90e6f-2c00-4dab-b961-385a3ace0c5c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.184230 Dec 09 01:09:17.893366 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 58/117] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:17 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:17.966885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:17.970268 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:17.985769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.986958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:17.988293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:17.988981 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.211354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:18.213662 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:18.232395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:18.234982 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.238763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.240293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.240463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e974a47f-5d35-472f-9451-773bb0a57fdb tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.279035 Dec 09 01:09:18.240901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.241751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 60/118] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:17 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:18.413581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:18.424320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f50b6289-44f3-4e71-9016-c4385ccd67d3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1317 microversion: 2.1 time: 0.220152 Dec 09 01:09:18.436106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:18 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:18.600577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:18.601266 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:18.613779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.614124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.617678 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.619425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.911868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:18.912944 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:18.922404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.922909 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:18.924305 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:18.924923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.056763 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:19.066118 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-016c6bff-df53-4794-951d-b2264d51ad2c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.470002 Dec 09 01:09:19.067115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 61/120] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:18 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:19.188764 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:19.197361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-949a453f-868d-4582-91f4-998468f85229 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.290720 Dec 09 01:09:19.200188 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 60/121] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:18 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:19.269304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:19.270220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:19.278435 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:19.279253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.280264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:19.281040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.442254 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:19.447425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:19.451024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:19.459856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0dfef4f6-bfdf-44dc-a3b3-fb30fa69767d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.202029 Dec 09 01:09:19.461944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:19 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:19.472770 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:19.473730 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.475185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:19.475630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.550358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-d42dabd7-eee5-4793-a5d2-7cc60f15d836 req-76194cd5-53ec-454b-b39c-9ea415b9d7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11e7d82-d6f0-4625-980e-40d38e06de06", "name": "network-vif-plugged", "status": "completed", "tag": "bf23067c-8af4-4fb6-9414-19f6cd332b66"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:19.553116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:19.553116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:19.561177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-d42dabd7-eee5-4793-a5d2-7cc60f15d836 req-76194cd5-53ec-454b-b39c-9ea415b9d7a0 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:19.562686 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-d42dabd7-eee5-4793-a5d2-7cc60f15d836 req-76194cd5-53ec-454b-b39c-9ea415b9d7a0 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:19.585911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-d42dabd7-eee5-4793-a5d2-7cc60f15d836 req-76194cd5-53ec-454b-b39c-9ea415b9d7a0 service nova] Creating event network-vif-plugged:bf23067c-8af4-4fb6-9414-19f6cd332b66 for instance b11e7d82-d6f0-4625-980e-40d38e06de06 on hv-cinder-79053 Dec 09 01:09:19.595381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-d42dabd7-eee5-4793-a5d2-7cc60f15d836 req-76194cd5-53ec-454b-b39c-9ea415b9d7a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049429 Dec 09 01:09:19.597043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 63/123] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Dec 09 01:09:19.651105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:19.660058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6e00c126-6996-4b98-9bb0-e82d59bca831 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1507 microversion: 2.1 time: 0.221436 Dec 09 01:09:19.661338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:19 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:20.084629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:20.086024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:20.097143 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.098486 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.099631 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.100320 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.217234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:20.218422 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:20.231580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.234192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.235963 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.236616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.456617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:20.465172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:20.466918 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1603bff2-abff-4343-81b6-9c53c19148b8 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1314 microversion: 2.1 time: 0.386363 Dec 09 01:09:20.473030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-adab2cf1-ed6c-4482-b8ad-7846f6884e50 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.260554 Dec 09 01:09:20.473603 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 62/125] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:20 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:20.477156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 64/126] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:20 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:20.482706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:20.483492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:20.489657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.490284 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.491282 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:20.491884 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:20.658055 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:20.680025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ae721be8-6a5c-49c5-92c3-81c80459dc20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.195251 Dec 09 01:09:20.680025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:20 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:21.489056 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:21.489618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:21.490583 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:21.490873 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:21.503082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.504274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.504798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.505249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.506219 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.506628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.507603 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.508041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.721406 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:21.731695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-dbd368a6-9d49-4cd4-a591-d10d32958d26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.246495 Dec 09 01:09:21.732275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:21 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:21.737126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:21.737727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:21.743923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.744373 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.745235 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:21.745921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:21.748631 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:21.757303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5dbfad61-8420-478a-b0bf-ba39a85ec937 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1501 microversion: 2.1 time: 0.277069 Dec 09 01:09:21.771572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:21 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:21.912384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:21.927888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b1629151-bece-415e-9a2a-d8921c01969a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.194207 Dec 09 01:09:21.929283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 65/130] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:21 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:22.748868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:22.749568 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:22.755552 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:22.756121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:22.758596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:22.759058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:22.898310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:22.906486 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a4975397-6af9-42f4-a821-91f4a7500d37 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.162611 Dec 09 01:09:22.907162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:22 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:22.945608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:22.946230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:22.952079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:22.952850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:22.953291 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:22.953728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:23.084840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:23.093029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a829531a-e292-4248-852d-7093b3265e77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1321 microversion: 2.1 time: 0.150944 Dec 09 01:09:23.093531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:22 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:23.924098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:23.924703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:23.931275 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:23.931720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:23.933023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:23.933534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.063329 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:24.070650 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eedb4883-3251-48e6-9648-1b996b8f4f54 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1363 microversion: 2.1 time: 0.150288 Dec 09 01:09:24.071207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:23 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:24.109862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:24.110443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:24.116372 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.116821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.117598 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.118032 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.255808 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:24.265375 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b51189e8-ea4e-4d0c-b7a4-3a4f738e9720 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1515 microversion: 2.1 time: 0.159197 Dec 09 01:09:24.265980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 67/134] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:24 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:24.287397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:24.288636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:24.294996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.295498 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.296353 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.296953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.373530 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'flavor' on Instance uuid 4617dfc6-89b9-4d31-b4bc-9c150258059d {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:09:24.525729 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f4361083-07a3-4df3-8fdd-383eca0d1cc3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d/action" status: 200 len: 32 microversion: 2.1 time: 0.241958 Dec 09 01:09:24.527125 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 68/135] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:24 2021] POST /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:24.536781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:24.537432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:24.551094 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.551545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.552419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:24.552855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:24.754293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:24.762900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1295f73e-818d-4062-911a-6c22a9d648b1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.229936 Dec 09 01:09:24.763847 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:24 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:25.088053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:25.088926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:25.096063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.096609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.097399 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.097869 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.310909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:25.318615 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7d910a17-4a4f-403c-a4f2-57ba9bf74054 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1550 microversion: 2.1 time: 0.234608 Dec 09 01:09:25.326715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:25 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1550 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:25.341060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:25.342316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:25.350585 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.355791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.356694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.357138 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.362021 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2d9004-b964-451d-8a73-409660a91347"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:25.363304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:25.374097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.380520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.381381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.382215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.537206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8d841d99-5371-4076-bbf2-3d36827ef037 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201520 Dec 09 01:09:25.537798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Dec 9 01:09:25 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:25.653856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "477d2e72-98c2-4b43-a907-38cdbda476c9"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:25.655421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:25.667953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.669326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:25.670392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:25.672215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:26.055598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5aa1ce41-a427-4e72-af8c-96e7269a00fa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "POST /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703456 Dec 09 01:09:26.056226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 70/139] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:09:25 2021] POST /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:26.062879 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:26.066471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:26.087942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:26.088676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:26.092374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:26.092873 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:26.197780 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4a97799d-ca89-4256-865b-644a9a3f6618 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547899 Dec 09 01:09:26.198518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 70/140] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:09:25 2021] POST /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:09:26.647852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:26.655754 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9532492f-dfaf-4b9c-8244-ede12030dd0c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.598413 Dec 09 01:09:26.656354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:26 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:27.173816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:27.174905 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:27.191003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-9cc2ec0f-a742-4232-8e63-e4dfaf7b9e30 req-8b38b561-8780-4d2b-ac1b-52d1c055cb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11e7d82-d6f0-4625-980e-40d38e06de06", "tag": "bf23067c-8af4-4fb6-9414-19f6cd332b66"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:27.192375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:27.192375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:27.197100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:27.197802 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:27.198595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:27.202082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9cc2ec0f-a742-4232-8e63-e4dfaf7b9e30 req-8b38b561-8780-4d2b-ac1b-52d1c055cb56 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:27.202760 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:27.205834 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9cc2ec0f-a742-4232-8e63-e4dfaf7b9e30 req-8b38b561-8780-4d2b-ac1b-52d1c055cb56 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:27.221274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-9cc2ec0f-a742-4232-8e63-e4dfaf7b9e30 req-8b38b561-8780-4d2b-ac1b-52d1c055cb56 service nova] Creating event network-changed:bf23067c-8af4-4fb6-9414-19f6cd332b66 for instance b11e7d82-d6f0-4625-980e-40d38e06de06 on hv-cinder-79053 Dec 09 01:09:27.227423 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-9cc2ec0f-a742-4232-8e63-e4dfaf7b9e30 req-8b38b561-8780-4d2b-ac1b-52d1c055cb56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042850 Dec 09 01:09:27.239785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 72/142] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:09:27.674738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:27.676100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:27.687829 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:27.689213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:27.690937 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:27.692131 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:27.869479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:27.877994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a3ceec30-de43-43a9-a326-47d00536a2e4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.209142 Dec 09 01:09:27.888648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:27 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:28.895564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:28.896198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:28.902450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:28.902901 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:28.903680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:28.904115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:29.037849 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:29.047550 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e5103a09-692f-4012-9ff6-26bb3bccf54a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.155611 Dec 09 01:09:29.048685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 74/144] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:28 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:29.556314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9c53aa82-6d97-41ae-9bb8-0636dc2aaaf5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 14 microversion: 2.1 time: 2.386718 Dec 09 01:09:29.556962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 71/145] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:27 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 14 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:30.064777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:30.065411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:30.072163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:30.072738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:30.074305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:30.074886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:30.297533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:30.305089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3d8e7c1a-65d7-4818-ad3c-dc2af863243b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.244026 Dec 09 01:09:30.315363 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 75/146] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:30 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:30.569515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:30.570554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:30.578709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:30.579170 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:30.579945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:30.580387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:30.685240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c8731a0f-4bb8-4de2-952a-c5d8644a3800 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 14 microversion: 2.1 time: 0.119754 Dec 09 01:09:30.688391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 72/147] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:30 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:31.322420 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:31.323257 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:31.329607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:31.330083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:31.330895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:31.331331 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:31.464487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:31.478862 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-179dd3d3-89ad-4106-883a-a58658265f83 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.159981 Dec 09 01:09:31.480385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 76/148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:31 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:31.696671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:31.698232 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:31.705635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:31.706276 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:31.707193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:31.707704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:32.497549 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:32.498071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:32.504695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:32.505148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:32.505935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:32.506433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:32.642106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:32.649376 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8c570c56-95cd-4410-a841-4ae4d9f07742 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.156342 Dec 09 01:09:32.649935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 77/149] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:32 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:33.665355 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:33.666080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:33.672779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:33.673225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:33.673996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:33.674463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:33.840445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:33.853905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b03730e7-8b47-44dd-8ba7-8e3423e38c4d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.191660 Dec 09 01:09:33.854576 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 78/150] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:33 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:34.113510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e67c2d6a-89df-4d93-975d-e59baa25bf2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 14 microversion: 2.1 time: 2.420620 Dec 09 01:09:34.116670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 73/151] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:31 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 14 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:34.871448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:34.872086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:34.878005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:34.878750 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:34.879776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:34.880274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:35.089573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:35.098064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-500b2d39-03ed-4816-9756-803721e47be6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.230945 Dec 09 01:09:35.098797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 79/152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:34 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:35.126840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:35.128071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:35.136970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:35.137472 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:35.138449 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:35.138889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:35.247048 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f20cbff8-f8cb-47e3-8489-89562e91f6e0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 14 microversion: 2.1 time: 0.126430 Dec 09 01:09:35.247707 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 74/153] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:35 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:36.115303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:36.115988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:36.123367 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:36.123826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:36.124590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:36.125023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:36.269866 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:36.271109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:36.298626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:36.299102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:36.299896 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:36.300335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:36.318316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:36.329986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-212287d5-d268-4ddb-9820-ab677ff87f23 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.217955 Dec 09 01:09:36.330900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 80/154] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:36 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:37.350218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:37.351265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:37.361049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:37.361795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:37.363132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:37.363856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:37.529422 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:37.547285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-010395ab-1978-47fe-aca7-c4bb6d23c3f3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.202473 Dec 09 01:09:37.550606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 81/155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:37 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:38.564243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:38.564886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:38.585244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:38.585960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:38.586985 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:38.587618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:38.738552 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:38.747134 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f69a9f4a-33e8-46a4-844d-7829573d9b28 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.186322 Dec 09 01:09:38.748195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 82/156] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:38 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:38.788165 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c1b899da-bb14-479e-bd7a-4c9d1a3ad4be tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 14 microversion: 2.1 time: 2.533676 Dec 09 01:09:38.788810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 75/157] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:36 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 14 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:09:39.767384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:39.769920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:39.785132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:39.786034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:39.787578 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:39.788893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:39.846966 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:39.855157 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:39.892817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:39.893417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:39.897346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:39.898767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:40.061311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:40.069543 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1a1f1bac-9d73-4a1a-8c95-598e6bd65ccc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.308743 Dec 09 01:09:40.075140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 83/158] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:39 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:41.086426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:41.087210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:41.094239 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:41.094722 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:41.095758 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:41.096198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:41.248041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:41.251544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fdc5b23b-d2f7-4b6b-8b45-840ee729c86b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.168738 Dec 09 01:09:41.252140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 84/159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:41 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:42.268561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:42.269251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:42.277823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:42.278500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:42.279079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:42.279513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:42.441799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:42.450068 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f20306dc-dd75-40cd-bc99-8478a6872b20 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.185435 Dec 09 01:09:42.450680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 85/160] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:42 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:43.326594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6d6881bf-eb93-42b4-914f-5885f79eddbb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 7357 microversion: 2.1 time: 3.511176 Dec 09 01:09:43.330202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 76/161] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:39 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 7357 bytes in 3516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:43.467230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:43.467953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:43.476358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:43.477006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:43.477970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:43.479375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:43.626676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:43.634608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ea0e93bc-424e-468f-bbae-b4ee93ba32e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.172288 Dec 09 01:09:43.635712 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 86/162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:43 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:44.337362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:44.339204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:44.351106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:44.351565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:44.352348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:44.352802 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:44.479667 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a9c8d029-654a-4563-b002-a466d0c599b8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 11454 microversion: 2.1 time: 0.145407 Dec 09 01:09:44.484789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 77/163] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:44 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 11454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:44.655402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:44.656087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:44.668056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:44.668502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:44.670282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:44.670922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:44.863674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:44.872506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c02d9d06-7933-4566-84fa-dfdec7701913 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.221764 Dec 09 01:09:44.873081 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 87/164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:44 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:45.489218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:45.489831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:45.497575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:45.498408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.499063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:45.499210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.500256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.500748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.520471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.520471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.520471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.520471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.528244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:09:45.622899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5f4a997e-24ae-49b8-8768-7142d4cf6699 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 204 len: 0 microversion: 2.1 time: 0.138768 Dec 09 01:09:45.624027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 78/165] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:09:45 2021] DELETE /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:09:45.632335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:45.633121 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:45.641358 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.641769 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.642661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.643064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.738231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-28e30d5f-140f-458d-969f-e245ac0663a7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 15064 microversion: 2.1 time: 0.250609 Dec 09 01:09:45.741116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 88/166] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:45 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 15064 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:09:45.813727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:45.819002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a9ac1dba-ab05-4c3b-864e-e8b4d0c52148 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1553 microversion: 2.1 time: 0.190526 Dec 09 01:09:45.819591 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 79/167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:45 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:45.890760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:45.891810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:45.901586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.902342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:45.903181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:45.903617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:46.074812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:46.084997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-248571a6-e491-4417-879c-3cb8e8edea71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.199588 Dec 09 01:09:46.086142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 89/168] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:45 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:46.751927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:46.753049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:46.760176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:46.760611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:46.761391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:46.761828 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:46.836688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:46.837459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:46.849710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:46.850725 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:46.851784 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:46.852422 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:46.889453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2c888652-8a3b-41e1-ab9c-300b43ccddf6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 17602 microversion: 2.1 time: 0.141191 Dec 09 01:09:46.890101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 80/169] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:46 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 17602 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:47.017312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:47.025190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-85f72766-64a4-4dc3-a946-593dcf84409c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1553 microversion: 2.1 time: 0.193042 Dec 09 01:09:47.026433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 90/170] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:46 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:47.103191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:47.105366 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:47.111928 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:47.112381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:47.113162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:47.113598 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:47.249881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:47.257877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f9b7bb2d-c545-47cd-994d-a41d9750e619 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.158628 Dec 09 01:09:47.258716 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 81/171] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:47 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:47.901563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:47.902609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:47.909198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:47.909578 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:47.910388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:47.910852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:48.044004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:48.045192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:48.051613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:48.052380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:48.053393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:48.053992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:48.102618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7c722030-0b3d-4e5e-ada3-392e3485e660 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 17602 microversion: 2.1 time: 0.205347 Dec 09 01:09:48.103689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 91/172] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:47 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 17602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:48.248525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:48.257554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d983c7de-3b06-477c-b9d7-77247d3eb04e tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1553 microversion: 2.1 time: 0.217366 Dec 09 01:09:48.258438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 82/173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:48 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:48.276329 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:48.277027 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:48.283702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:48.284154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:48.284939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:48.285386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:48.425179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:48.434008 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e715bb30-c57c-4cf1-ab68-7596fbd0f909 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.162204 Dec 09 01:09:48.434550 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 92/174] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:48 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:49.114383 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:49.115897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:49.124259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.124259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.124861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.125620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.277756 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:49.278656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:49.295637 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.296312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.297121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.298157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.330156 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ae4bac14-c3b5-4a8f-8afd-ec8f014523d3 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 18153 microversion: 2.1 time: 0.219407 Dec 09 01:09:49.331120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 83/175] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:49 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 18153 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:49.452118 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:49.453408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:49.460980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.461634 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.462876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:49.463531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:49.560156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:49.568507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d28e4aef-7635-46e9-b567-b446afc4901d tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1553 microversion: 2.1 time: 0.294991 Dec 09 01:09:49.568886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 93/176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:49 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:49.730425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:49.756171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1e5202e3-1cb4-4290-b2d4-ffb5ab0e0f48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.308853 Dec 09 01:09:49.767287 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 84/177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:49 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:50.115316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-6d7afd6f-7231-41ff-b850-71f37da7131b req-64c9aa3a-5d41-48ec-9e3e-8569ef745339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd973508-e7e7-40a7-8166-8690649e69a4", "name": "network-vif-deleted", "tag": "a87c89e2-1888-4b5a-82fd-824571febafc"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:50.117177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:09:50.117177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:09:50.130257 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-6d7afd6f-7231-41ff-b850-71f37da7131b req-64c9aa3a-5d41-48ec-9e3e-8569ef745339 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.134737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-6d7afd6f-7231-41ff-b850-71f37da7131b req-64c9aa3a-5d41-48ec-9e3e-8569ef745339 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.160186 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-6d7afd6f-7231-41ff-b850-71f37da7131b req-64c9aa3a-5d41-48ec-9e3e-8569ef745339 service nova] Creating event network-vif-deleted:a87c89e2-1888-4b5a-82fd-824571febafc for instance cd973508-e7e7-40a7-8166-8690649e69a4 on hv-cinder-79053 Dec 09 01:09:50.161949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-6d7afd6f-7231-41ff-b850-71f37da7131b req-64c9aa3a-5d41-48ec-9e3e-8569ef745339 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050804 Dec 09 01:09:50.163142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 94/178] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:09:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:09:50.342756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:50.343762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:50.355067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.356199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.359670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.360231 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.499413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-08d070fb-1eab-4ac8-9434-ff207741d44f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 19539 microversion: 2.1 time: 0.160256 Dec 09 01:09:50.500641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 85/179] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:50 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 19539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:50.586817 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:50.588799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:50.594943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.595717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.596688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.597188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.660485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b74ad2c40f4a7caf926c7954046137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f744683c3f364dda933c885766c8dfec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:50.669009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a4e3b309-2c41-4966-ace9-d42cd7189ffa tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 200 len: 1345 microversion: 2.1 time: 0.086125 Dec 09 01:09:50.669701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 95/180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:50 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:50.777708 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:50.778762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:50.792643 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.793670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.794671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:50.795343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:50.968568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:50.977872 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6ef72d43-3bc4-4898-b146-0c4c7801e7e0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.206889 Dec 09 01:09:50.978515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 86/181] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:50 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:51.512900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:51.514144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:51.520876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.521328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.522216 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.522913 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.649176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-61ad34a7-d8fb-47c2-adee-344f6707d13f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 21442 microversion: 2.1 time: 0.141144 Dec 09 01:09:51.650800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 96/182] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:51 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 21442 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:51.688489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:51.689149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:51.698019 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.698503 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.699303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.699742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.713436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] HTTP exception thrown: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. Dec 09 01:09:51.714058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Returning 404 to user: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:09:51.714867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8b0b622e-d57d-437e-8182-6f805f6af9ff tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 404 len: 111 microversion: 2.1 time: 0.033464 Dec 09 01:09:51.715452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 87/183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:51 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:09:51.871930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:51.872948 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:51.880093 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.880762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.881939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:51.882396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:51.897716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] HTTP exception thrown: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. Dec 09 01:09:51.898555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Returning 404 to user: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:09:51.899555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e5af45a1-8255-4f92-a3c9-f4fbe9dd3442 tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032318 Dec 09 01:09:51.900320 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 97/184] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:09:51 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:09:51.996499 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:51.997192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:52.008525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:52.008985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:52.011057 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:52.011670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:52.208454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:52.218075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-73cf0789-2e73-4fb2-b8bd-1e2b482c406c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.226392 Dec 09 01:09:52.218917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 88/185] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:51 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:52.661746 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:52.664897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:52.677161 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:52.677819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:52.678894 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:52.680162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:52.818109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cd5e3faa-3df2-4379-a382-53461ab86964 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 22589 microversion: 2.1 time: 0.160259 Dec 09 01:09:52.819213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 98/186] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:52 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 22589 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:53.156420 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:53.157718 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:53.171881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.172673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.173817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.174664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.191893 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] HTTP exception thrown: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. Dec 09 01:09:53.192962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Returning 404 to user: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:09:53.194185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fa041d0c-78ad-440f-b1c8-87c169364aca tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 404 len: 111 microversion: 2.1 time: 0.041834 Dec 09 01:09:53.195172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 89/187] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:09:53 2021] DELETE /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:09:53.206451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:53.207796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] [instance: cd973508-e7e7-40a7-8166-8690649e69a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:53.217106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.217930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.219045 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.219953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.236153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:53.236767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:53.238480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] HTTP exception thrown: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. Dec 09 01:09:53.239480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] Returning 404 to user: Instance cd973508-e7e7-40a7-8166-8690649e69a4 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:09:53.240941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-55b93426-c5f3-4c72-8d93-fd448083334c tempest-DeleteServersTestJSON-351325075 tempest-DeleteServersTestJSON-351325075-project] 10.222.0.23 "GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4" status: 404 len: 111 microversion: 2.1 time: 0.040015 Dec 09 01:09:53.241663 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 99/188] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:53 2021] GET /compute/v2.1/servers/cd973508-e7e7-40a7-8166-8690649e69a4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:09:53.247474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.248174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.249996 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.250812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.293752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1961418742", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "2daaacf1-f17f-4c3f-8d5f-6ec019bc5236"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:53.684797 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:53.696839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-526fdd0e-6aed-4960-be8a-00519b535eaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.464069 Dec 09 01:09:53.708060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 90/189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:53 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:09:53.830203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:53.831481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:53.842622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.852748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.856041 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:53.857083 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:53.998890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6b711bdc-c47d-41ea-8f89-c7788cc27c77 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 23228 microversion: 2.1 time: 0.172089 Dec 09 01:09:53.999743 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 91/190] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:53 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 23228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:09:54.715459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:54.716874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:54.748031 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:54.750292 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:54.757406 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:54.763136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:55.104806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:55.115441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f159e843-a566-4d50-a72e-6b3b532973e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.404989 Dec 09 01:09:55.117898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 92/191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:54 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:55.167639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:55.168708 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:55.174835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:55.181859 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:55.183222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:55.188534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:55.336878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7747ea73-5ec4-4bef-b1b4-a4d4fd707e04 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 24363 microversion: 2.1 time: 0.204482 Dec 09 01:09:55.338414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 93/192] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:55 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 24363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:56.136070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:56.137278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:56.149448 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:56.149915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:56.151293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:56.151735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:56.347195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:56.360350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ff37d101-d91d-40da-9cbd-a1922832a67c tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.227833 Dec 09 01:09:56.361123 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 94/193] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:56 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:56.374349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:56.376941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:56.385742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:56.386833 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:56.388070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:56.389297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:56.534488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-84696c14-5884-4e0c-befe-88126509929e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 24952 microversion: 2.1 time: 0.171919 Dec 09 01:09:56.538553 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 95/194] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:56 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 24952 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:57.381405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:57.382176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:57.397338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:57.398089 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:57.399109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:57.401868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:58.094535 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:58.104049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b688168c-8a28-40d4-afbf-cf4a70fd6b95 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.726416 Dec 09 01:09:58.104766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 96/195] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:57 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:58.109919 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:58.111633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:58.120363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:58.123979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:58.125337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:58.126035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:58.247433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5586e468-e51f-49b8-b3ca-b043e214b2b4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 25962 microversion: 2.1 time: 0.140404 Dec 09 01:09:58.248172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 97/196] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:58 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 25962 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:09:59.125453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:09:59.126221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:59.138863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:59.139329 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:59.140135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:59.140693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:59.364320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:09:59.374933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0dc74bc3-74e8-4171-81f3-468a3761c401 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.256932 Dec 09 01:09:59.383070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 98/197] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:09:59 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:09:59.388709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:09:59.390068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:09:59.401460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:59.401930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:59.403171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:09:59.403610 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:09:59.550803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4e311969-08fe-4d64-9c6e-2fe6d6d705e1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 26559 microversion: 2.1 time: 0.164587 Dec 09 01:09:59.558756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 99/198] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:09:59 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 26559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:00.400814 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:00.401398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:00.416264 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:00.416451 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:00.425602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:00.428871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:00.900721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:00.910173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-428de266-6142-420c-b66b-d77ef452e7c1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.513815 Dec 09 01:10:00.914985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 100/199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:00 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:00.920539 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:00.925568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:00.937901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:00.938342 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:00.939293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:00.939809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:01.105638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5b0f285e-8bd4-4ef9-b3f4-8d2b388a3ac6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 27239 microversion: 2.1 time: 0.188508 Dec 09 01:10:01.106825 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 101/200] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:00 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 27239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:01.934315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:01.935257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:01.953017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:01.960936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:01.961983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:01.963812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:02.804737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:02.816941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e0f7f2d8-e0d8-4967-ad0b-be9e7ed56862 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.885405 Dec 09 01:10:02.817773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 102/201] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:01 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:02.827834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:02.843258 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:02.866661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:02.867281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:02.868097 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:02.869150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:03.028175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8933c7e4-63a6-469c-a9dc-1ecdab8e904b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 27723 microversion: 2.1 time: 0.208950 Dec 09 01:10:03.032674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 103/202] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:02 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 27723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:03.835259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:03.836044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:03.874778 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:03.875362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:03.876236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:03.876740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:04.236764 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:04.247429 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ffcc4247-94fd-4e73-bd7f-6d73580ead0a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.416396 Dec 09 01:10:04.261014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 104/203] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:03 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:04.266357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:04.268362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:04.275379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:04.276195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:04.278313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:04.279017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:04.429228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-17732438-96cf-452f-a8f8-13b24aba8c4e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28143 microversion: 2.1 time: 0.166672 Dec 09 01:10:04.430115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 105/204] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:04 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28143 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:05.265978 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:05.266790 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:05.281620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:05.282074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:05.284870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:05.285197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:05.697770 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:05.707648 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f533889e-c0f6-45dd-8060-ac9851d0b776 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.447269 Dec 09 01:10:05.717598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] validate_networks() for [('2daaacf1-f17f-4c3f-8d5f-6ec019bc5236', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:10:05.718112 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 106/205] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:05 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:05.723809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:05.725014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:05.736691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:05.737148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:05.738197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:05.739116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:05.891961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8cc5203f-6c57-4a5d-9760-300c524dda7f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28143 microversion: 2.1 time: 0.171587 Dec 09 01:10:05.893576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 107/206] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:05 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28143 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:06.673768 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:10:06.674768 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:10:06.675604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:10:06.676167 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:10:06.676902 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:10:06.702593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:06.703051 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:06.703861 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:06.704301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:06.724782 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:06.725484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:06.729919 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:06.735738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:06.736067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for user 59d2b98f1809405ab307a035062400c2 and project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:06.736207 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:06.737961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:06.738443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:06.750130 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:10:06.752982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:10:06.860037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bbc21d79-c52b-4684-ae10-6e08b9345ce9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.570631 Dec 09 01:10:06.861547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 100/207] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:09:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 13573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 09 01:10:06.882877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c8499fcf-3036-4385-b781-82320eacef35 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:06.894882 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c8499fcf-3036-4385-b781-82320eacef35 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:07.111537 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c8499fcf-3036-4385-b781-82320eacef35 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:07.140771 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c8499fcf-3036-4385-b781-82320eacef35 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1218 microversion: 2.1 time: 0.273435 Dec 09 01:10:07.164219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 101/208] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:06 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:07.177987 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:07.179019 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:07.203166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:07.203634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:07.204571 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:07.205043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:07.281383 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:07.289541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-06e95f18-776b-496f-8481-14780abbd79a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.569239 Dec 09 01:10:07.294649 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 108/209] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:06 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:07.407061 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-847f30d0-6ebc-437c-b237-55af1e6145fc tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28434 microversion: 2.1 time: 0.237915 Dec 09 01:10:07.407951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 102/210] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:07 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28434 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:08.170788 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:08.171499 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:08.182639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.183397 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.184370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.185011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.277018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:08.285875 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6e57dc59-f41e-4844-b7a5-f165d0e68ac2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1214 microversion: 2.1 time: 0.118619 Dec 09 01:10:08.290694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 109/211] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:08 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:08.310743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:08.311481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:08.331398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.332070 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.333124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.333749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.419920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:08.420849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:08.435312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.440620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.441555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:08.442151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:08.598327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-08b75cc9-c9ee-48e4-af6a-3a2239934ede tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28434 microversion: 2.1 time: 0.182578 Dec 09 01:10:08.599193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 110/212] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:08 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28434 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:08.647963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:08.659148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2ecf5d9f-037d-40df-8ef4-90c52388bb0d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1521 microversion: 2.1 time: 0.355660 Dec 09 01:10:08.668570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 103/213] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:08 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:09.310620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:09.312062 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:09.327856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.330920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.332483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.333077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.618011 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:09.620374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:09.638796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.641235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.642288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.646233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.787757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bad28b91-79ea-4e6d-b5d5-8d5a4c6756f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28600 microversion: 2.1 time: 0.179114 Dec 09 01:10:09.788596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 104/214] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:09 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:09.796616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:09.797603 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:09.810349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.811107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.812445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:09.813032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:09.987786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:10.001922 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-61c4982f-4490-4d8c-8434-69bcfe08e275 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1276 microversion: 2.1 time: 0.697492 Dec 09 01:10:10.002753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:09 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1276 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:10.214866 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:10.222656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5c140644-5d55-4251-a2d7-c546632d8ab6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1501 microversion: 2.1 time: 0.432723 Dec 09 01:10:10.223237 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 105/216] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:09 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:10.238737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:10.240794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:10.249744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:10.250653 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:10.251650 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:10.252256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:10.532711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:10.546046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e5c1ff30-83ed-419e-b4b3-0262d8d0045f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1516 microversion: 2.1 time: 0.311112 Dec 09 01:10:10.558694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 112/217] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:10 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:10.801469 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:10.803614 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:10.822693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:10.823809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:10.827489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:10.839810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:11.016479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5d077661-f8c5-4cde-bd2f-e0618983f7ad tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28600 microversion: 2.1 time: 0.219413 Dec 09 01:10:11.017515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 106/218] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:10 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:11.019733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:11.020353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:11.028867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:11.029320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:11.030103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:11.030567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:11.451783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:11.451783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b0d59202-d9c2-4c35-b615-a359599b6a36 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.435631 Dec 09 01:10:11.452787 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 113/219] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:11 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:12.029021 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:12.030572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:12.069878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.072532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.075097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.076792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.222435 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:12.223798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:12.251183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.253678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.262005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.269427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.270264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7b71d579-9e58-4eec-bd5b-f633efc7d42e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28600 microversion: 2.1 time: 0.245613 Dec 09 01:10:12.280334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 107/220] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:12 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:12.296486 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'flavor' on Instance uuid d49e39a7-1ec1-4033-ae68-8088625993b3 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:10:12.472066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:12.472984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:12.500485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.501076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.502014 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.502605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.696239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9ceb1af1-8911-4eb3-a5f8-12c384e82d11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action" status: 200 len: 32 microversion: 2.1 time: 0.478420 Dec 09 01:10:12.696792 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 114/221] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:12 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:10:12.710014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-5035f2cd-9b45-452f-950d-ab78be93204a req-10931951-5063-4309-ae54-3dca13920d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c3a262-97b1-463d-b2cb-fd476120796c", "tag": "2d101058-b44e-46a7-aee8-3153c4df184a"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:12.715249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:12.715249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:10:12.732691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-5035f2cd-9b45-452f-950d-ab78be93204a req-10931951-5063-4309-ae54-3dca13920d62 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.739117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-5035f2cd-9b45-452f-950d-ab78be93204a req-10931951-5063-4309-ae54-3dca13920d62 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.773228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-5035f2cd-9b45-452f-950d-ab78be93204a req-10931951-5063-4309-ae54-3dca13920d62 service nova] Creating event network-changed:2d101058-b44e-46a7-aee8-3153c4df184a for instance e3c3a262-97b1-463d-b2cb-fd476120796c on hv-cinder-79053 Dec 09 01:10:12.787582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-5035f2cd-9b45-452f-950d-ab78be93204a req-10931951-5063-4309-ae54-3dca13920d62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088703 Dec 09 01:10:12.791508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 115/222] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:12.799878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:12.805077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:12.828343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.831235 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:12.837574 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:12.841958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:13.225177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:13.235580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f18bb116-ee76-4fcd-9594-e2de6d35be09 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.767899 Dec 09 01:10:13.236748 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 108/223] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:12 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:13.285858 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:13.287620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:13.491913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:13.501041 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9db5ab16-9ebd-4d3e-a812-3fac25d3659f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.707011 Dec 09 01:10:13.502680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 116/224] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:12 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:13.705739 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:13.706490 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:13.707686 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:13.708333 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:13.816985 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-657477c6-a38a-4098-be1d-2946365bb7f5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28600 microversion: 2.1 time: 0.536652 Dec 09 01:10:13.818437 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 109/225] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:13 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28600 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:10:14.265976 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:14.266973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:14.273573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.275037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.276492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.277126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.523484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:14.525161 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:14.532221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.532706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.538997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.539635 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.783429 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:14.793721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-da1ac78d-12b8-47ce-8945-ff02c835e19d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.544093 Dec 09 01:10:14.795053 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:14 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:14.828800 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:14.831551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:14.840028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.840477 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.841260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:14.844613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:14.927507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:14.941672 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3e2e7a6e-a68b-4d93-b173-aa6857819938 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.423289 Dec 09 01:10:14.942947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 110/227] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:14 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:15.007788 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d212bf9c-ecb4-47ca-84cb-0704d621d355 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 28632 microversion: 2.1 time: 0.182359 Dec 09 01:10:15.013463 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 118/228] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:14 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 28632 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:10:15.811508 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:15.812287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:15.820297 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:15.821016 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:15.822162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:15.822810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:15.959454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:15.960148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:15.974526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:15.975613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:15.976850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:15.978215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:16.023368 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:16.039535 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-538f9368-964b-41b0-b012-b5d87467d484 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.229415 Dec 09 01:10:16.050557 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 111/229] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:15 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:16.063841 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:16.065347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:16.077218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:16.077734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:16.078608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:16.079221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:16.224551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-67dd9f90-d168-44df-a598-dea69f305173 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 29632 microversion: 2.1 time: 0.172613 Dec 09 01:10:16.231051 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 112/230] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:16 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 29632 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:16.330220 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:16.341922 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-934d04e1-4b83-45c3-a992-ecca756a373a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.385553 Dec 09 01:10:16.344980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 119/231] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:15 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:17.062032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:17.062749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:17.079620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.080382 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.081343 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.081780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.238438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:17.240023 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:17.248613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.259678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.260791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.261354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.320117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:17.337497 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-69190d7a-d2ce-479c-8abe-66b62cadde6c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.278142 Dec 09 01:10:17.340156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 113/232] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:17 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:17.368526 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:17.370033 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:17.384832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.386358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.388936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:17.390696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:17.410011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ee5dd1aa-1c5b-4b99-9136-6d7d7bd63f58 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 32513 microversion: 2.1 time: 0.175599 Dec 09 01:10:17.414349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 120/233] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:17 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 32513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:10:17.689277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:17.697274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-31f151e4-230d-4abd-9b6b-810819d8a146 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.340101 Dec 09 01:10:17.703881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 114/234] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:17 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:18.359280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:18.361092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:18.373679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.374615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:18.375378 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.375887 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:18.421296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:18.422072 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:18.433190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.433643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:18.434468 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.434910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:18.581252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:18.593436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-70c19b4e-71d4-4f48-935d-66c114d79374 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.240416 Dec 09 01:10:18.595124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 121/235] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:18 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:18.595267 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-96879e34-c9a6-4c3f-a7be-65aa1afc1d87 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 33292 microversion: 2.1 time: 0.177213 Dec 09 01:10:18.596573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 115/236] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:18 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 33292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:18.722237 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:18.723868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:18.753472 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.757877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:18.761856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:18.763959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.058287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-c8d2f8c4-bac6-450b-9990-ba11a5440f9e req-a76fa464-6df3-4cd2-9129-626ec3560edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c3a262-97b1-463d-b2cb-fd476120796c", "name": "network-vif-plugged", "status": "completed", "tag": "2d101058-b44e-46a7-aee8-3153c4df184a"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:19.063088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:19.063088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:10:19.090568 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c8d2f8c4-bac6-450b-9990-ba11a5440f9e req-a76fa464-6df3-4cd2-9129-626ec3560edf service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:19.091723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c8d2f8c4-bac6-450b-9990-ba11a5440f9e req-a76fa464-6df3-4cd2-9129-626ec3560edf service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.110981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:19.114562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-c8d2f8c4-bac6-450b-9990-ba11a5440f9e req-a76fa464-6df3-4cd2-9129-626ec3560edf service nova] Creating event network-vif-plugged:2d101058-b44e-46a7-aee8-3153c4df184a for instance e3c3a262-97b1-463d-b2cb-fd476120796c on hv-cinder-79053 Dec 09 01:10:19.121602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-c8d2f8c4-bac6-450b-9990-ba11a5440f9e req-a76fa464-6df3-4cd2-9129-626ec3560edf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071627 Dec 09 01:10:19.122971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 116/237] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:19.126154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-46065921-dada-4bfc-8aa2-a313cb8839ec tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.408866 Dec 09 01:10:19.137977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 122/238] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:18 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:19.608351 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:19.611561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:19.614140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:19.614997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:19.625200 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:19.626645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.629848 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:19.631855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.650070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:19.650611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.651470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:19.657578 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:19.792721 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f742d251-5c84-45de-96a6-48ece8e93dc5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 34369 microversion: 2.1 time: 0.189213 Dec 09 01:10:19.793892 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 117/239] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:19 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 34369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:20.023510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:20.038066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ef543a88-0214-4675-94fd-1fff179894e9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.430409 Dec 09 01:10:20.038839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 123/240] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:19 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:20.145107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:20.145809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:20.154043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:20.155917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:20.155917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:20.176602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:20.402617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:20.412655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-430ba258-3ada-46c6-930f-236d87412cc7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.272219 Dec 09 01:10:20.413224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 118/241] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:20 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:20.805895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:20.807118 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:20.820316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:20.820938 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:20.826107 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:20.826648 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:21.055779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:21.056327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:21.064685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:21.065153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:21.065955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:21.066426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:21.216198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:21.224197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f88cb3d3-d9ed-414d-a32d-04acf5e69342 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.172202 Dec 09 01:10:21.226354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 119/242] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:21 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:21.434766 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:21.435811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:21.442631 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:21.443188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:21.444074 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:21.444581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:21.606389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:21.614108 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-42f9c367-e072-48b3-aff1-2a0d3b4a1e97 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.185657 Dec 09 01:10:21.615006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 120/243] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:21 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:22.241166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:22.241899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:22.251963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:22.252425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:22.253207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:22.253702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:22.433681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:22.441852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d938c3c3-00b6-448f-828b-12d1a118a4a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.204678 Dec 09 01:10:22.442450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 121/244] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:22 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:22.630818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:22.631534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:22.638789 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:22.639316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:22.640334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:22.640775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:22.782522 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:22.790332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-58255cc5-3855-4c43-bdb6-3b19836ebe11 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.162524 Dec 09 01:10:22.790912 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 122/245] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:22 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:22.850136 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'create', calling method: .version_select at 0x7fe61a13ce50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-742202461"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:22.864446 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:22.869400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for user fc6ef8627a3a40638168ed0d45c19d95 and project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:23.261265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-48e4b162-dc54-4e08-928b-e1ec1e30e371 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 37172 microversion: 2.1 time: 2.459393 Dec 09 01:10:23.262303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 124/246] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:20 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 37172 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:10:23.356619 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:23.360224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for user fc6ef8627a3a40638168ed0d45c19d95 and project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:23.374406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f0cb5d8e-baac-4871-b82a-9045b7e400c4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.527933 Dec 09 01:10:23.374406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 123/247] 10.222.0.23 () {60 vars in 1157 bytes} [Thu Dec 9 01:10:22 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:23.458974 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:23.459676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:23.467502 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:23.468148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:23.469289 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:23.470124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:23.476095 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-416308010", "imageRef": "b59d70ba-894a-4790-8773-1e25be6ee9f0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-742202461", "networks": [{"uuid": "809b49f8-c565-416c-be1f-d21f8f13109c"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:23.529055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] validate_networks() for [('809b49f8-c565-416c-be1f-d21f8f13109c', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:10:23.689145 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:23.697240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-497ffe1a-400e-4622-9a0d-0541eca6752d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1318 microversion: 2.1 time: 0.242180 Dec 09 01:10:23.697810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 125/248] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:23 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:23.808406 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:23.809016 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:23.815250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:23.815705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:23.816579 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:23.817021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.230910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:10:24.231359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:10:24.231819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:10:24.232232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:10:24.232652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:10:24.245638 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.245878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:24.246591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.247663 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.248436 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.253215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a420864a-6c30-44dd-8cc1-74ab03cf3191 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.449174 Dec 09 01:10:24.253791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 126/249] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:23 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:24.267747 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:24.272015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Getting quotas for user fc6ef8627a3a40638168ed0d45c19d95 and project d6d5beaac0f5499ebdb7f15879cf5c9b. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:24.273081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:24.274116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:24.280599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.281164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.282263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.282811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.284520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:10:24.286850 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b59d70ba-894a-4790-8773-1e25be6ee9f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:10:24.343056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b44727b6-8b58-4655-8116-48a3e6c0d875 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870613 Dec 09 01:10:24.343793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 124/250] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:10:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 09 01:10:24.355088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b8c68c0c-5c6b-4399-be31-320c9e7eca99 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:24.355707 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b8c68c0c-5c6b-4399-be31-320c9e7eca99 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:24.410132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8a018ac2-77a9-49c9-ae93-71abc76f7547 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 37771 microversion: 2.1 time: 0.140193 Dec 09 01:10:24.412059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 127/251] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:24 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 37771 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:24.413071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b8c68c0c-5c6b-4399-be31-320c9e7eca99 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:24.421185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b8c68c0c-5c6b-4399-be31-320c9e7eca99 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1257 microversion: 2.1 time: 0.070722 Dec 09 01:10:24.421771 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 125/252] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:24 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:24.714105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:24.714933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:24.722346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.722830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.723627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.724177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.878610 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:24.890107 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-242083f0-f73c-4279-80b7-1ca5145c0e78 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1509 microversion: 2.1 time: 0.180341 Dec 09 01:10:24.892026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 128/253] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:24 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:24.908716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "477d2e72-98c2-4b43-a907-38cdbda476c9"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:24.909858 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:24.916060 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.916506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:24.917279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:24.917712 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.002255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Invalid volume: volume 477d2e72-98c2-4b43-a907-38cdbda476c9 is already attached to instances: 3d2b888f-f816-49a9-ad1b-5aec93ff2873 Dec 09 01:10:25.002931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 400 to user: Invalid volume: volume 477d2e72-98c2-4b43-a907-38cdbda476c9 is already attached to instances: 3d2b888f-f816-49a9-ad1b-5aec93ff2873 {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:10:25.003758 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c5bc09aa-a91a-4652-9771-881d1e9771b8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099128 Dec 09 01:10:25.004315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 126/254] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:10:24 2021] POST /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 09 01:10:25.074573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:25.075144 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:25.083430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.083948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.084729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.085194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.209195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'services' on Instance uuid 3d2b888f-f816-49a9-ad1b-5aec93ff2873 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:10:25.270249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:25.271094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:25.277376 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.277943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.278955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.279691 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.335229 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-439f17ab-7909-407e-bb91-33e802b598f8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments/477d2e72-98c2-4b43-a907-38cdbda476c9" status: 202 len: 0 microversion: 2.1 time: 0.273837 Dec 09 01:10:25.335998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 129/255] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:10:25 2021] DELETE /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments/477d2e72-98c2-4b43-a907-38cdbda476c9 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:10:25.344855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:25.346100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:25.353684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.354534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.355394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.356124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.393140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-66935eef-c6c0-4801-b28a-32a0cc7575e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052548 Dec 09 01:10:25.393900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 130/256] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:25 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:25.427282 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:25.429218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:25.436554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.437001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.438228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.438755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.463108 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:25.472258 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-683de384-6adc-4d2b-9cdb-b1be3439ec39 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.205655 Dec 09 01:10:25.472825 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 127/257] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:25 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:25.478132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:25.478766 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:25.484402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.484846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.485618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:25.486054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:25.554396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:25.566823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ca4dc93d-10a3-4577-ad88-c8562abb6a2c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1309 microversion: 2.1 time: 0.092880 Dec 09 01:10:25.568024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 128/258] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:25 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:25.598482 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8c2a9184-a624-4cbb-bbb3-f36bd9357246 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 38109 microversion: 2.1 time: 0.177272 Dec 09 01:10:25.604185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 131/259] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:25 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 38109 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:26.404892 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:26.405836 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:26.412244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.412695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.413471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.413932 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.442738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3ab18a6b-4ecb-4388-9531-dc1a0e469eaf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041502 Dec 09 01:10:26.443280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 129/260] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:26 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:26.489063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:26.489749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:26.497253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.497689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.498490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.498921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.584182 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:26.584899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:26.591475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.591928 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.592710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.593149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.643714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:26.654247 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8564a0e5-b35e-4528-a1c4-4a3b0e322f66 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.169022 Dec 09 01:10:26.658811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:26.663315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 132/261] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:26 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:26.666190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a3c2072d-aaeb-4722-ad1f-78a5a6e27baa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1315 microversion: 2.1 time: 0.085845 Dec 09 01:10:26.666819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 130/262] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:26 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1315 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:26.668583 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:26.669526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:26.675355 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.675812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:26.676605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:26.677043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.454132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:27.457996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:27.461574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.462090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.462896 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.463330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.491996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-037b2eb8-2232-4488-9737-d72dc2400754 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Dec 09 01:10:27.493100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 131/263] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:27 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:27.670775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:27.671411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:27.677215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.677674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.678463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.678903 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.814697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:27.822587 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a6380909-edb4-4683-80a9-fca3f379f2b2 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.155616 Dec 09 01:10:27.823244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 132/264] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:27 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:27.827585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:27.828270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:27.833834 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.834288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.835109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:27.835548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:27.897093 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:27.904652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-520f11d5-6353-44f0-a468-d37a7ab8e383 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1315 microversion: 2.1 time: 0.080393 Dec 09 01:10:27.905218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:27 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1315 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:28.503585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:28.504516 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:28.510861 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.511426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:28.512098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.512539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:28.545586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-17b5c4ab-1610-4815-ae9b-79dc57b852ee tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Dec 09 01:10:28.546324 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 134/266] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:28 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:28.839553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:28.841250 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:28.850644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.851352 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:28.852421 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.853042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:28.885593 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-39f0f30c-72ad-4918-911a-2194206a579e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 38109 microversion: 2.1 time: 2.220505 Dec 09 01:10:28.886251 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 133/267] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:26 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 38109 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:28.921443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:28.922467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:28.929334 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.929864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:28.931300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:28.931808 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:29.024449 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:29.034253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4e6fe24f-e8c2-4e15-a685-b69bccb7bd3f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1315 microversion: 2.1 time: 0.116715 Dec 09 01:10:29.035007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 134/268] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:28 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1315 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:29.101054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:29.115977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a3408c6a-bb6c-4495-a203-fd56e0abc494 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.280497 Dec 09 01:10:29.118226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 135/269] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:28 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:29.560686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:29.563552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:29.580913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:29.583306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:29.588439 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:29.589215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:29.668413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8c3ae17c-6f31-4c4a-b1ae-bb8a99fe9b14 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114872 Dec 09 01:10:29.679004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 135/270] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:29 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:29.896995 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:29.897911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:29.904338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:29.904793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:29.905570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:29.906005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.051308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:30.051926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:30.058679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.059137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.059921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.060355 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.231889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:30.241198 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5fb6aad4-5742-49ff-8050-0fff0eb7c109 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.193368 Dec 09 01:10:30.241786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 136/271] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:30 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:30.247323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:30.247937 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:30.253597 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.254049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.254854 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.255294 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.405661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:30.413124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0832f5f7-6832-4d0a-9e13-aeef2674ce48 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.170377 Dec 09 01:10:30.414026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 137/272] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:30 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:30.681385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:30.682316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:30.688490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.688938 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.689735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:30.690171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:30.722315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-eebeb462-07a9-42f7-b833-56ac63a9bb85 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045052 Dec 09 01:10:30.722928 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 138/273] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:30 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:31.260799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:31.261797 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:31.269071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.269561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.270412 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.271063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.412216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:31.420024 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3c05cbbd-b635-4fbb-8609-b51f87696fcf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.164727 Dec 09 01:10:31.420602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 139/274] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:31 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:31.430362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:31.431238 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:31.437418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.437870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.438693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.439132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.572816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:31.580627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0589c0c9-506e-49b4-997b-9081ddab8be1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.154175 Dec 09 01:10:31.581881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 140/275] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:31 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:31.734120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:31.735196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:31.741101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.741548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.742480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:31.743714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:31.772121 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-41f70f04-350e-42bb-a02c-c7e2c1cc4515 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Dec 09 01:10:31.772681 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 141/276] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:31 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:32.454081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:32.455519 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:32.462839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.463292 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.464086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.464526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.619609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:32.627178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c347885d-b03c-40a4-9ea3-fcab194e25ae tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.179093 Dec 09 01:10:32.627757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 142/277] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:32 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:32.631963 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:32.632754 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:32.642768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.643310 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.644110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.644544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.779757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:32.786920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9d728efa-c48a-4c8c-bc53-8e361a93461e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.158232 Dec 09 01:10:32.787481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 143/278] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:32 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:32.792491 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:32.793375 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:32.798794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.799240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.800008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:32.800436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:32.828365 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6899b0a9-e7f6-4fa8-a0f2-8821ebd7816a tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039933 Dec 09 01:10:32.828904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 144/279] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:32 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:33.643871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:33.644553 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:33.652490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:33.653010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:33.654045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:33.655531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:33.825017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:33.833111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c35c4451-5184-4472-9933-e9bef8a5f1e9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.192812 Dec 09 01:10:33.833939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 145/280] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:33 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:33.839340 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:33.839943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:33.860223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:33.860655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:33.861487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:33.861929 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:34.023402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:34.036011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f3177e6c-a89c-40c6-a33f-a4dbee6514de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.200453 Dec 09 01:10:34.047643 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 146/281] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:33 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:34.052555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:34.053695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:34.060576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:34.061028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:34.061820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:34.062256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:34.097495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4bb4bf3f-8d38-4e69-ab6f-b73571ea7d01 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048437 Dec 09 01:10:34.098413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 147/282] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:34 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:34.851056 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:34.852370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:34.858529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:34.859103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:34.860526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:34.861106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:34.998324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:35.009515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0680dbdd-1ed3-4b0f-bf0d-d3fb5a586b54 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.162526 Dec 09 01:10:35.010196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 148/283] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:34 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:35.053829 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:35.054469 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:35.064189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:35.065617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:35.066859 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:35.067569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:35.208962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:35.218119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a3f98c33-bd06-4d2a-8dce-4fdffbbcd8f5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.167996 Dec 09 01:10:35.218933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 149/284] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:35 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:35.226385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:35.228868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:35.236193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:35.236723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:35.237578 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:35.238073 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:35.267886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7dcf5577-2ee9-48ce-ab87-5bf8441cc0a8 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Dec 09 01:10:35.268433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 150/285] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:35 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:36.025989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:36.026746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:36.032945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.033403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.034191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.034657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.179208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:36.187370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ccadc427-5eee-4d21-bfab-570f6ffe33a1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.165222 Dec 09 01:10:36.187936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 151/286] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:36 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:36.236356 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:36.236975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:36.243095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.243548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.244400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.244846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.391539 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:36.401088 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2fea038c-450e-4642-a88c-17199e4ab943 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.168528 Dec 09 01:10:36.401736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 152/287] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:36 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:36.406402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:36.407361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:36.414304 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.415130 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.416095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:36.416631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:36.460914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a287cb6b-2835-48de-8b34-3264cf695635 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058017 Dec 09 01:10:36.461604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 153/288] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:36 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:37.214917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:37.216131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:37.223371 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.223972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.224869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.225434 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.405991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:37.414113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-02178b23-e6db-4903-a9df-92b6d78d3f02 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.211306 Dec 09 01:10:37.415421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 154/289] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:37 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:37.426059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:37.426695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:37.432822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.433275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.434064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.434526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.595998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:37.609631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f5333f21-13e0-4fb3-aad3-b456852fd4db tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.186942 Dec 09 01:10:37.611584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 155/290] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:37 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:37.619651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:37.621285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:37.628956 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.629530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.630398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:37.630893 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:37.663838 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1b8382e5-3f30-4c41-a277-ccc91b8dc8f7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050778 Dec 09 01:10:37.664948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 156/291] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:37 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:37.670317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-226062554", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "54da1fdd-8934-41b2-b4b2-5871ab439c53"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:37.723820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] validate_networks() for [('54da1fdd-8934-41b2-b4b2-5871ab439c53', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:10:38.131364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:10:38.131792 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:10:38.132620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:10:38.133387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:10:38.134175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:10:38.146129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.146611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.147436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.147878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.174517 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Getting quotas for project a965b3ef21e14d8787cc1b57b914f806. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:38.178885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Getting quotas for user d0b8bb5afcbc4159b3f6256d8fe93997 and project a965b3ef21e14d8787cc1b57b914f806. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:38.198139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:10:38.200521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:10:38.272926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-bdb11d41-59b0-4bdc-99d5-28a33941100a tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606336 Dec 09 01:10:38.272926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 157/292] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:10:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:10:38.301082 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-87681240-a7a2-4898-b838-28ae5ea315a5 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:38.301880 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-87681240-a7a2-4898-b838-28ae5ea315a5 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:38.406118 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-87681240-a7a2-4898-b838-28ae5ea315a5 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:38.414277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-87681240-a7a2-4898-b838-28ae5ea315a5 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1213 microversion: 2.1 time: 0.125375 Dec 09 01:10:38.421469 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 158/293] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:38 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:38.433768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:38.434805 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:38.448270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.448935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.450073 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.450749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.667744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:38.676295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3954f44d-38a0-47b0-867e-585e04d4f233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.246375 Dec 09 01:10:38.687155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 159/294] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:38 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:38.691777 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:38.692398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:38.711444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.712111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.712908 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.713348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.899323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:38.909558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-754cdeab-47b2-4ffa-b906-a6e585a0ed14 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.221242 Dec 09 01:10:38.910149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 160/295] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:38 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:38.920156 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:38.921353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:38.929379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.929914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.930729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:38.931164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:38.963168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b26725c1-5190-43ed-bef8-3941ee16aa28 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051942 Dec 09 01:10:38.963734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 161/296] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:38 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:39.434170 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:39.435078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:39.442413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.442913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:39.443671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.444105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:39.515864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:39.524002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b68b8097-f064-420d-a522-77e0d3ccd35d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1217 microversion: 2.1 time: 0.094598 Dec 09 01:10:39.524711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 162/297] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:39 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:39.694353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:39.695049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:39.703231 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.703692 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:39.704494 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.704934 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:39.848962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:39.859299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c5cc6949-e082-4d9c-bedb-b6cb6f3a0458 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.168881 Dec 09 01:10:39.859872 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 163/298] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:39 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:39.929678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:39.931782 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:39.942682 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.943142 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:39.944074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:39.944533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.088617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:40.098384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-921186a5-75f6-4d78-bdd5-a95f1f9eaf77 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.174032 Dec 09 01:10:40.107647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 164/299] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:39 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:40.107647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:40.107647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:40.112642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.113106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.113917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.114359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.144515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0a08b51d-cbfb-47d0-9b9c-a291edd83647 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Dec 09 01:10:40.145277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 165/300] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:40 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:40.541426 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:40.542114 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:40.548426 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.548878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.549663 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.550099 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.624647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:40.632239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c1af18b8-37a3-43b3-bd3f-4d79f660950e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1217 microversion: 2.1 time: 0.095043 Dec 09 01:10:40.633588 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 166/301] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:40 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:40.876735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:40.877387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:40.883551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.883998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:40.884773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:40.885206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.025752 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:41.033697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6f13f703-16e7-42ad-8f81-090c19fe416b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.160632 Dec 09 01:10:41.034521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 167/302] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:40 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:41.116934 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:41.117589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:41.123458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.123906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.124690 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.125126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.268182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:41.276526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-00fea428-b4f6-4d8a-8ef4-630d8f6528df tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.163371 Dec 09 01:10:41.277105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 168/303] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:41 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:41.283115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:41.285707 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:41.295704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.296175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.296967 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.297404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.330207 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-10a824d6-cfb8-492b-81ea-6016b7664cff tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Dec 09 01:10:41.330798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 169/304] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:41 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:41.650839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:41.651520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:41.657770 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.658223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.659044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:41.659483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:41.723005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:41.731516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-09250a2f-2a4d-414c-ae6e-1da0a225176b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1217 microversion: 2.1 time: 0.085055 Dec 09 01:10:41.731995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 170/305] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:41 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:42.051115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:42.051725 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:42.058020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.058506 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.059283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.059719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.189484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:42.197719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-248f9036-a630-415a-9fd3-46778b779c28 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.150207 Dec 09 01:10:42.198278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 171/306] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:42 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:42.294315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:42.294951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:42.300745 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.301248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.301966 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.302432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.455921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bc2337f3-4429-437c-bb28-485b63a6d0c0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 200 len: 38240 microversion: 2.1 time: 12.562399 Dec 09 01:10:42.456574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 136/307] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:29 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 38240 bytes in 12564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:10:42.462142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:42.463207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:42.470715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.478016 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.487561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.488326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.528671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-30660305-9183-4206-b671-df82be70111d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070894 Dec 09 01:10:42.529374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 137/308] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:10:42 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:10:42.535150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:42.535891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:42.543721 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.544421 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.545429 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.546057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.575890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1af482d1-9125-4fce-a4b7-47c89a237daa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/ips" status: 200 len: 145 microversion: 2.1 time: 0.044659 Dec 09 01:10:42.586716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 138/309] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:10:42 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:42.623055 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:42.631674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-13fce052-2c38-45f5-bdfb-7feb18ab6e08 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.342546 Dec 09 01:10:42.632625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 172/310] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:42 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:42.732079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-891351970", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "2daaacf1-f17f-4c3f-8d5f-6ec019bc5236"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:42.749822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:42.750486 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:42.764023 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.768457 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.769536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:42.770033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:42.807883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] validate_networks() for [('2daaacf1-f17f-4c3f-8d5f-6ec019bc5236', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:10:42.866545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:42.874465 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-13ec60d1-412c-470d-b1a7-c2d2947d47ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1265 microversion: 2.1 time: 0.129815 Dec 09 01:10:42.875269 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 173/311] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:42 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:43.215658 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:43.216315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:43.224900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.225392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.226192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.227134 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.817757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:43.830857 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e0cd6918-0448-4d0b-8945-78039f10b8b8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.618006 Dec 09 01:10:43.831831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 174/312] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:43 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:43.860940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-4e9419bc-5774-44d2-8cc2-ac882ded47ae req-bd8b286c-5bdd-4d18-8d5b-3b89a45a3334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:43.863333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:43.863333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:10:43.878684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-4e9419bc-5774-44d2-8cc2-ac882ded47ae req-bd8b286c-5bdd-4d18-8d5b-3b89a45a3334 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.879300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-4e9419bc-5774-44d2-8cc2-ac882ded47ae req-bd8b286c-5bdd-4d18-8d5b-3b89a45a3334 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.896815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-4e9419bc-5774-44d2-8cc2-ac882ded47ae req-bd8b286c-5bdd-4d18-8d5b-3b89a45a3334 service nova] Creating event network-changed:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:10:43.905476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-4e9419bc-5774-44d2-8cc2-ac882ded47ae req-bd8b286c-5bdd-4d18-8d5b-3b89a45a3334 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071955 Dec 09 01:10:43.906816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 175/313] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:43.920081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:43.921364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:43.932904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.933427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.934530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.935158 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.956689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:10:43.957717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:10:43.958598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:10:43.959473 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:10:43.960348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:10:43.982199 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.983059 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:43.984428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:43.985075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:44.056005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:44.066794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for user 59d2b98f1809405ab307a035062400c2 and project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:44.104390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:10:44.109821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:10:44.239063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-31cb4312-3f56-4ca2-8c52-cdc3fc814f46 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513398 Dec 09 01:10:44.240359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 139/314] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:10:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:10:44.245083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:44.250076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:44.265027 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:44.270396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:44.271335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:44.271852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:44.483774 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:44.493888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6ae73855-a446-45d6-aedf-2e8dcedaaa50 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.585318 Dec 09 01:10:44.500189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 176/315] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:43 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:44.512031 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-34e606ba-0d64-4b87-9bb2-de3ee8af53e2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:44.513504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-34e606ba-0d64-4b87-9bb2-de3ee8af53e2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:44.651453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-34e606ba-0d64-4b87-9bb2-de3ee8af53e2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:44.660733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-34e606ba-0d64-4b87-9bb2-de3ee8af53e2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1217 microversion: 2.1 time: 0.157616 Dec 09 01:10:44.662816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 177/316] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:44 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:44.738643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:44.749491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6aa3e510-8988-4dae-a5d3-cc797111fe4d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.507885 Dec 09 01:10:44.750338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 140/317] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:44 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:44.851095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:44.852520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:44.860334 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:44.860776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:44.861565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:44.862002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.160525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:45.173380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-207f218b-8afd-46c7-89e3-2c510631bc46 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.329490 Dec 09 01:10:45.176398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 178/318] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:44 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:45.516746 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:45.517885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:45.527185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.527645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.528448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.528886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.625669 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ff055ac-3333-409b-8afa-e2accd2c79a7"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:45.628014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:45.636135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.636831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.637976 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.638987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.796734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:45.804541 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e290c1be-3a63-465e-a9ec-e91fc6111770 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.292868 Dec 09 01:10:45.805126 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 141/319] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:45 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:45.809518 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:45.810126 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:45.818720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.819241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.820784 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.821566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.901256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:45.910920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b1d137a2-bdaf-4860-9751-b0db3f249098 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1269 microversion: 2.1 time: 0.104106 Dec 09 01:10:45.912300 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 142/320] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:45 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:45.925029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:45.925679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:45.932765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.933371 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:45.934160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:45.934621 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.081132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:46.089145 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7d4832b6-23c5-487b-83ca-c31c4feb182b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.175135 Dec 09 01:10:46.089573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 143/321] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:45 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:46.104943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-3ada694a-e58c-4f30-8178-d7ccc44b8e9e req-e40a9421-9075-4867-9819-4ec531298f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b28adeb-ac02-4117-b5f7-9f363afd487a", "tag": "e20fa842-3843-4cb5-84e7-4413a72e5f3e"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:46.106713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:46.106713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:10:46.114336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-3ada694a-e58c-4f30-8178-d7ccc44b8e9e req-e40a9421-9075-4867-9819-4ec531298f77 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.114899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-3ada694a-e58c-4f30-8178-d7ccc44b8e9e req-e40a9421-9075-4867-9819-4ec531298f77 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.127092 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-3ada694a-e58c-4f30-8178-d7ccc44b8e9e req-e40a9421-9075-4867-9819-4ec531298f77 service nova] Creating event network-changed:e20fa842-3843-4cb5-84e7-4413a72e5f3e for instance 0b28adeb-ac02-4117-b5f7-9f363afd487a on hv-cinder-79053 Dec 09 01:10:46.132181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-3ada694a-e58c-4f30-8178-d7ccc44b8e9e req-e40a9421-9075-4867-9819-4ec531298f77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031081 Dec 09 01:10:46.133549 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 144/322] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:46.193601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:46.194451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:46.201060 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.201611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.202487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.203114 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.348042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:46.357042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e3d71449-965f-49aa-8920-62f0a182c604 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.167602 Dec 09 01:10:46.358076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 145/323] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:46 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:46.821924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:46.822610 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:46.828904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.829359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.830134 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.830607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.968401 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:46.977855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-89a2c070-833b-4545-a706-46cfd87b1ac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.160059 Dec 09 01:10:46.978573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 146/324] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:46 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:46.982882 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:46.983520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:46.989240 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.989691 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:46.990500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:46.990975 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:47.051124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:47.059139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d63f2cd9-cae8-40c8-b525-642ee1c6346d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1277 microversion: 2.1 time: 0.079608 Dec 09 01:10:47.059698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 147/325] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:46 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:47.105570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:47.106117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:47.112084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:47.112536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:47.113322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:47.113762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:47.245774 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:47.252956 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a6eb9eba-b2a3-4f6c-ae8d-d1f77ff27146 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.150898 Dec 09 01:10:47.253502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 148/326] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:47 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:47.373270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:47.373804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:47.379706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:47.380156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:47.380928 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:47.381366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:47.516794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:47.524787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-33cf2516-99cc-4eb8-b2e1-846ab846ab88 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.155159 Dec 09 01:10:47.525919 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 149/327] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:47 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:47.998585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:47.999294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:48.005126 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.005580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.006383 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.006827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.137528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:48.144641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-65105653-e486-455b-a220-8e722e8516de tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.153131 Dec 09 01:10:48.145198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 150/328] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:47 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:48.150803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:48.151410 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:48.157477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.157983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.158790 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.159249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.221099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:48.228787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-95f1e503-980f-43d1-9827-53bae63ef1e0 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1277 microversion: 2.1 time: 0.082611 Dec 09 01:10:48.229342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 151/329] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:48 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:48.268972 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:48.269727 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:48.275600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.276043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.276813 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.277245 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.428525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:48.436601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4b5e96bd-b1c2-4d50-99e2-6ee1efb0eac1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.171085 Dec 09 01:10:48.437166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 152/330] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:48 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:48.543733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:48.544391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:48.551171 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.551620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.552395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:48.552827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:48.712398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:48.720175 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-658b3b6c-1616-4bc2-bd4c-3fc99bff6b8e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.181707 Dec 09 01:10:48.720916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 153/331] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:48 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:49.046250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f7d25f21-d3e6-4f97-9bfa-93b15b4a0f9b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.424219 Dec 09 01:10:49.046940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 179/332] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:10:45 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments => generated 194 bytes in 3426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:10:49.163261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:49.167606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.175144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.175596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.176377 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.176855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.247215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:49.248187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.254727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.255257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.256127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.256765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.324997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:49.336744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d5501a88-b65e-4880-b068-270a2a3a5db9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1275 microversion: 2.1 time: 0.094191 Dec 09 01:10:49.352519 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 180/333] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:49 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:49.434825 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:49.443141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-db5c7798-ccce-4dce-ad05-eead42ccc225 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1502 microversion: 2.1 time: 0.283856 Dec 09 01:10:49.444838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 154/334] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:49 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:49.454794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:49.456022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.460415 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f3421bf-df39-447e-81a7-ca26fc540111"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:49.462514 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.464526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.464903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.466183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.467435 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.479846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.480730 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.481703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.482298 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.513103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] HTTP exception thrown: Cannot 'attach_volume' instance d49e39a7-1ec1-4033-ae68-8088625993b3 while it is in vm_state rescued Dec 09 01:10:49.513662 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Returning 409 to user: Cannot 'attach_volume' instance d49e39a7-1ec1-4033-ae68-8088625993b3 while it is in vm_state rescued {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:10:49.514518 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ef42247a-b2db-4aa5-a23b-4beb22327271 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057923 Dec 09 01:10:49.515531 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 155/335] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:10:49 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 09 01:10:49.525350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:49.526242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.533145 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.533818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.534860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.535340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.652074 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8d26e506-127a-4cf1-b790-982e8418d9a4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action" status: 202 len: 0 microversion: 2.1 time: 0.131774 Dec 09 01:10:49.652800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 156/336] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:49 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:10:49.672444 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:49.673318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.682483 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.683286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.684292 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.684911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.897077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:49.910038 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6f6a1402-9f0b-4f6c-93a1-b581f146268f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.458163 Dec 09 01:10:49.911150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 181/337] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:49 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:49.917187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:49.918603 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:49.929629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.930336 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.931605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:49.932185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:49.987513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:50.000335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fc6b233f-c7ca-4607-8872-7c539400d894 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1510 microversion: 2.1 time: 0.342231 Dec 09 01:10:50.012453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 157/338] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:49 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:50.222974 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:50.237694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-69cf6f67-afad-48bc-a54b-3733fbd25d24 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.323882 Dec 09 01:10:50.238942 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 182/339] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:49 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:50.358648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:50.359778 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:50.367369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:50.368022 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:50.368887 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:50.369333 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:50.627356 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:50.637964 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f3cf0935-cfdc-4d9c-b37a-8dd974e422a9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.282801 Dec 09 01:10:50.639202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 158/340] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:50 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:50.927079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:50.927693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:50.934590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:50.935075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:50.935864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:50.936303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.023882 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:51.024496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:51.030824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.031274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.032066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.032500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.109813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:51.118624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a87e95a9-3287-492d-9a5a-2ea71cc60cd8 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.195124 Dec 09 01:10:51.128652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 183/341] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:50 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:51.202115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:51.211060 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-abae8e9d-a6cd-4014-9eff-eef3e04c20ad tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1510 microversion: 2.1 time: 0.191383 Dec 09 01:10:51.211756 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 159/342] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:51 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:51.266577 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:51.267204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:51.274518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.275667 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.276886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.277509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.374438 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-0e6e7f68-b334-4921-af6c-1c7d480ba1ab req-135bb74d-a5e6-4c4b-aae0-8e91bfcae9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b20e4d-c9a1-48c1-b548-a2ee5a24035e", "tag": "510d459c-7c9d-470e-af1b-5c8eb4265ba1"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:51.377688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:51.377688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:10:51.408973 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-0e6e7f68-b334-4921-af6c-1c7d480ba1ab req-135bb74d-a5e6-4c4b-aae0-8e91bfcae9ce service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.409719 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-0e6e7f68-b334-4921-af6c-1c7d480ba1ab req-135bb74d-a5e6-4c4b-aae0-8e91bfcae9ce service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.440073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-0e6e7f68-b334-4921-af6c-1c7d480ba1ab req-135bb74d-a5e6-4c4b-aae0-8e91bfcae9ce service nova] Creating event network-changed:510d459c-7c9d-470e-af1b-5c8eb4265ba1 for instance 58b20e4d-c9a1-48c1-b548-a2ee5a24035e on hv-cinder-79053 Dec 09 01:10:51.455271 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-0e6e7f68-b334-4921-af6c-1c7d480ba1ab req-135bb74d-a5e6-4c4b-aae0-8e91bfcae9ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085081 Dec 09 01:10:51.456400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 160/343] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:51.503101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:51.511381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0616b999-3bc6-4145-8121-5cab9f3a40f4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.258851 Dec 09 01:10:51.512001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 184/344] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:51 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:51.656803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:51.657544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:51.666586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.669600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.670661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:51.671296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:51.915304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:51.928609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9a29222a-f523-4cf9-8fa2-101feee1a36c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.276543 Dec 09 01:10:51.930085 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 161/345] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:51 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:52.136573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:52.137301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:52.144348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.144881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.145881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.146547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.229378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:52.230826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:52.240481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.241286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.243251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.244077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.417539 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:52.435595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-04244a50-b4f5-48bc-915f-9df724742c9e tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.303928 Dec 09 01:10:52.440238 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 185/346] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:52 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:52.530523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:52.531479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:52.531891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:52.538004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.538731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.539675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.540265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.545003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c93461e2-2061-436a-8c9f-fc45a10ba096 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1510 microversion: 2.1 time: 0.318808 Dec 09 01:10:52.547837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 162/347] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:52 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:52.773719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:52.789228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ff7aa0e6-89dd-4d79-bc1a-f5b0a399ae4b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.262305 Dec 09 01:10:52.790308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 186/348] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:52 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:52.945492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:52.946345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:52.953094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.953611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:52.954489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:52.954989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.111170 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:53.120088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c9e85b83-2799-4173-8400-2ae497276e4d tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.178200 Dec 09 01:10:53.120954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 163/349] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:52 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:53.461322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:53.462076 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:53.478539 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.479329 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.480817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.481492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.564011 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:53.564899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:53.571318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.572032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.573058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.573599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.732443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:53.748069 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-96c2137e-593c-485b-9eec-f89fdbfa81d7 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.297737 Dec 09 01:10:53.749891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 187/350] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:53 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:53.808537 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:53.809302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:53.815225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.815661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.816448 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:53.816879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:53.846155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:53.855954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-30f48e5e-ca8f-4766-9237-796caf82ca8b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1516 microversion: 2.1 time: 0.294815 Dec 09 01:10:53.858399 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 164/351] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:53 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:54.073978 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:54.086014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2185245f-fb88-443e-be4e-864297fe2556 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.282117 Dec 09 01:10:54.087190 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 188/352] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:53 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:54.136811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:54.137509 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:54.143599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:54.144053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:54.144846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:54.145290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:54.359575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:54.367220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2557c736-f8cd-4e06-a723-049e675f4e13 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.234115 Dec 09 01:10:54.367775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 165/353] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:54 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:54.768918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:54.769698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:54.781341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:54.781837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:54.783099 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:54.783665 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.107893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:55.110005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:55.129501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.130575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.131632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.132990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.222245 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:55.231820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1f2d550e-62b8-4636-a702-dd82fd80cb4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.467738 Dec 09 01:10:55.233614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 189/354] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:54 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:55.353685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:55.356182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:55.356835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:55.361456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-70a80199-b479-47c7-8005-57a4a0691995 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.261357 Dec 09 01:10:55.362108 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 166/355] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:55 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:55.362908 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.363362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.364212 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.364713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.387202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:55.387811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:55.394087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.394578 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.395522 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.395963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.574820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:55.582898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-105c939a-8f82-4ef8-b6c6-87b698ab6e06 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1516 microversion: 2.1 time: 0.230371 Dec 09 01:10:55.583683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 190/356] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:55 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:55.593140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:55.602719 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4ad682bd-4898-477f-917d-e16816cf62ce tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.219272 Dec 09 01:10:55.603155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b341ef30-d5d6-4f2e-94f4-e1d18a282472"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:55.603743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 167/357] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:55 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:55.604444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:55.610679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.611381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.612839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:55.612927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:55.969795 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-16f896cc-bbba-4f3d-883a-e4b3020a51a8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370614 Dec 09 01:10:55.970881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 191/358] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:10:55 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:56.087562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-84db94e6-7805-4ea3-8cb1-56e5aa9a828f req-78e40c73-4c45-45ab-9ded-c356f8562bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "name": "network-vif-plugged", "status": "completed", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:56.090124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:56.090124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:10:56.098505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-84db94e6-7805-4ea3-8cb1-56e5aa9a828f req-78e40c73-4c45-45ab-9ded-c356f8562bb8 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.099226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-84db94e6-7805-4ea3-8cb1-56e5aa9a828f req-78e40c73-4c45-45ab-9ded-c356f8562bb8 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.113367 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-84db94e6-7805-4ea3-8cb1-56e5aa9a828f req-78e40c73-4c45-45ab-9ded-c356f8562bb8 service nova] Creating event network-vif-plugged:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:10:56.122697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-84db94e6-7805-4ea3-8cb1-56e5aa9a828f req-78e40c73-4c45-45ab-9ded-c356f8562bb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040377 Dec 09 01:10:56.123598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 168/359] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:56.254952 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:56.255658 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:56.270126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.270712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.271866 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.272391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.383390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:56.384352 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:56.398688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.401452 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.402523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.405615 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.562711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:56.578714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-31fbf67c-e0e2-4043-a059-afc752bd5237 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.327405 Dec 09 01:10:56.579453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 192/360] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:56 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:56.586846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-480050794", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "e483c8cb-55ef-4f74-8353-e0031b35ed31"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:56.680384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] validate_networks() for [('e483c8cb-55ef-4f74-8353-e0031b35ed31', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:10:56.786531 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:56.796923 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-13e338ff-444c-4785-89a7-fbd5aa7540f8 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.420983 Dec 09 01:10:56.797562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 169/361] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:56 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:56.803223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:56.803999 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:56.810340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.810832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:56.811634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:56.812072 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.070995 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:57.079793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f166b90c-832b-471f-b5f9-a909dd92e7bc tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.281174 Dec 09 01:10:57.084418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 170/362] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:56 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:57.099227 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c037f6dc-cf16-4495-bf09-9293a72cf9df tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:10:57.116466 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c037f6dc-cf16-4495-bf09-9293a72cf9df tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.117586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c037f6dc-cf16-4495-bf09-9293a72cf9df tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.186484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:10:57.187775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:10:57.188292 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:10:57.188713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:10:57.189185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:10:57.204964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.205852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c037f6dc-cf16-4495-bf09-9293a72cf9df tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Going to try to stop instance {{(pid=116067) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 09 01:10:57.206082 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.207513 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.208876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.231298 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Getting quotas for project a00edc9fc6a744efa5c33e63db2a7eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:10:57.235798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Getting quotas for user 7b9f193140654d6b9e2efbae04524b57 and project a00edc9fc6a744efa5c33e63db2a7eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:10:57.252286 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:10:57.254758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:10:57.263880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c037f6dc-cf16-4495-bf09-9293a72cf9df tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 202 len: 0 microversion: 2.1 time: 0.168000 Dec 09 01:10:57.264890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 171/363] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:10:57 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:10:57.274875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:57.275955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:57.283748 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.284208 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.285121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.285582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.310891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c24c8bd8-5716-4984-b586-341dd54c423c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728884 Dec 09 01:10:57.317749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 193/364] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:10:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:10:57.323533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b0c19e61-c5f0-4f8f-95a8-420072ced0fd tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:57.324204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b0c19e61-c5f0-4f8f-95a8-420072ced0fd tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:57.405495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b0c19e61-c5f0-4f8f-95a8-420072ced0fd tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:57.413459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b0c19e61-c5f0-4f8f-95a8-420072ced0fd tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1218 microversion: 2.1 time: 0.093830 Dec 09 01:10:57.415363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 194/365] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:57 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:57.487474 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:57.496378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-625debce-6674-4402-8f9f-90fc563585f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.226764 Dec 09 01:10:57.497208 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 172/366] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:57 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:57.597308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:57.597937 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:57.606019 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.606642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.607450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.608510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.775580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:57.782964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-539e4aa3-3d6f-49ea-9137-5abff07d73a4 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.190536 Dec 09 01:10:57.783534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 195/367] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:57 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:57.814860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:57.815464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:57.821934 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.822475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.823256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:57.823694 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:57.963057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:57.970954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eb542bd7-bd19-4246-ad7d-d07f4a4f8ff7 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1357 microversion: 2.1 time: 0.159980 Dec 09 01:10:57.971518 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 173/368] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:57 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:58.100861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:58.101779 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:58.108313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.108701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.109496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.109935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.248644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:58.256409 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-63f6d461-1dab-4066-8f0d-59aa48ea154b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.159250 Dec 09 01:10:58.257628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 196/369] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:58 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:58.432337 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:58.432947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:58.439270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.439724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.440499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.440941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.504657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:58.514244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-efb85b4f-e241-4772-a614-c90c5601db74 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1270 microversion: 2.1 time: 0.086582 Dec 09 01:10:58.514862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:58.515523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:58.517044 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 174/370] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:58 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:58.521824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.522269 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.523151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.523578 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.658601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:58.666959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-abc332c7-1547-4d10-9199-10ad7a801b6c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.155703 Dec 09 01:10:58.667451 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 197/371] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:58 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:10:58.799641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:58.800316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:58.806909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.807340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.808148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.808595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.958446 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:58.967072 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f2d81998-8fa0-486c-81a2-ad0ad5c21bc0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.171062 Dec 09 01:10:58.967881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 175/372] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:58 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:58.987178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:58.987783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:58.993986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.994479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:58.995346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:58.995834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.167629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:59.179829 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-114c2e2e-4720-4401-a8da-12730d17dedf tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1548 microversion: 2.1 time: 0.195428 Dec 09 01:10:59.180866 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 198/373] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:58 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:59.198629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.199292 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:59.212561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.221470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.222737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.223381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.278303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.279068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:59.286528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.287136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.288226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.289485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.413677 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:59.430652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-839765e4-1dbb-4ab4-903e-b89e391bc974 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1548 microversion: 2.1 time: 0.235831 Dec 09 01:10:59.431276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 176/374] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:59.451973 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.459103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:10:59.459103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:10:59.462389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:59.463676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Searching by: {'deleted': False, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b'} {{(pid=116067) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 09 01:10:59.477107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.478651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.479903 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.480454 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.499984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:59.517833 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5fb9db74-1201-4d8c-92ce-be516a0f7e6f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.243019 Dec 09 01:10:59.519168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 199/375] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:59.536391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.537376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:59.544044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.544738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.545722 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.546302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.613561 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.multi_cell_list [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116067) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 09 01:10:59.632874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:10:59.642951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7208bf0f-d025-400c-bd40-b22ead1cf0d7 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1276 microversion: 2.1 time: 0.112558 Dec 09 01:10:59.643960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 200/376] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:10:59.685609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.686291 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:59.703029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.705384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.708496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.710860 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.739391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-99f12376-fc2f-412f-b76b-7d979895d029 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.295467 Dec 09 01:10:59.740515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 177/377] 10.222.0.23 () {58 vars in 1124 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers => generated 342 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:10:59.757702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:10:59.758514 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:10:59.764997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.765450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:10:59.766297 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:10:59.766929 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.006689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:00.013828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:00.017951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7dfe6462-0964-4fc9-b994-f5f6efc9f52c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.337994 Dec 09 01:11:00.018900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 201/378] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:00.023334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-961ede2b-58e0-4422-ab12-8e357a331022 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1548 microversion: 2.1 time: 0.275848 Dec 09 01:11:00.030427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 178/379] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:10:59 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1548 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:00.030427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:00.032802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:00.036459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-68af4f26-7d55-4f6b-96b4-44297155cfcc req-eb682125-9c3d-4d7b-b120-642cd0e7770f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28adeb-ac02-4117-b5f7-9f363afd487a", "name": "network-vif-plugged", "status": "completed", "tag": "e20fa842-3843-4cb5-84e7-4413a72e5f3e"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:00.039460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:00.039460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:00.046104 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.046594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.047393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.047859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.049460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-68af4f26-7d55-4f6b-96b4-44297155cfcc req-eb682125-9c3d-4d7b-b120-642cd0e7770f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.050095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-68af4f26-7d55-4f6b-96b4-44297155cfcc req-eb682125-9c3d-4d7b-b120-642cd0e7770f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.065945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-68af4f26-7d55-4f6b-96b4-44297155cfcc req-eb682125-9c3d-4d7b-b120-642cd0e7770f service nova] Creating event network-vif-plugged:e20fa842-3843-4cb5-84e7-4413a72e5f3e for instance 0b28adeb-ac02-4117-b5f7-9f363afd487a on hv-cinder-79053 Dec 09 01:11:00.072987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-68af4f26-7d55-4f6b-96b4-44297155cfcc req-eb682125-9c3d-4d7b-b120-642cd0e7770f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052665 Dec 09 01:11:00.074127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 202/380] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:00.367990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:00.378013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7048426b-3139-4bab-9344-09cba0c5f619 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.352937 Dec 09 01:11:00.399942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 179/381] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:00 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:00.537895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:00.539497 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:00.546100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.546732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.547670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.548373 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.660738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:00.661350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:00.668462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.669127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.669915 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.670433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.692116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:00.700025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8e100503-bc0a-4c9b-b0ed-313fefc9d4a6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.166622 Dec 09 01:11:00.700605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 203/382] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:00 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:00.764111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-67c9be69-f401-4076-8e8c-d354740c5dfd req-33ca060c-e103-4884-bb2d-436bbd22d523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceeb0702-18c0-4c51-9173-464d3c1eba87", "tag": "9403bd16-5fd9-412f-8e51-2c5dad3f9013"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:00.765629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:00.765629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:00.772338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-67c9be69-f401-4076-8e8c-d354740c5dfd req-33ca060c-e103-4884-bb2d-436bbd22d523 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:00.774600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-67c9be69-f401-4076-8e8c-d354740c5dfd req-33ca060c-e103-4884-bb2d-436bbd22d523 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:00.785703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-67c9be69-f401-4076-8e8c-d354740c5dfd req-33ca060c-e103-4884-bb2d-436bbd22d523 service nova] Creating event network-changed:9403bd16-5fd9-412f-8e51-2c5dad3f9013 for instance ceeb0702-18c0-4c51-9173-464d3c1eba87 on hv-cinder-79053 Dec 09 01:11:00.798154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-67c9be69-f401-4076-8e8c-d354740c5dfd req-33ca060c-e103-4884-bb2d-436bbd22d523 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037575 Dec 09 01:11:00.798803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 204/383] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:00.811023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:00.818326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-42509531-6560-421a-8f18-e4dc386973f4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.161176 Dec 09 01:11:00.818901 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 180/384] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:00 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:01.035650 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:01.036401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:01.043843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.044294 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.045151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.046015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.192984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:01.203058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-33bcfcaf-32be-4617-9c6b-b7351c25e286 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.171020 Dec 09 01:11:01.213476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 205/385] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:01 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:01.407408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:01.408235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:01.416998 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.417582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.418735 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.419282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.558798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:01.566032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b0d95dda-f325-479b-adaa-61dcd352d1f0 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1313 microversion: 2.1 time: 0.162971 Dec 09 01:11:01.566616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 181/386] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:01 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:01.717495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:01.719290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:01.726993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.727738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.728744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.729242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.737629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31026095-e261-493b-baf7-f9c9b8f79d81"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:01.738914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:01.745617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.746285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.747097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.747532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.872903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:01.880582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4674eea8-9729-4231-af89-7756622ea976 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.167319 Dec 09 01:11:01.881151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 206/387] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:01 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:01.885739 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:01.886347 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:01.892196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.892652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:01.893463 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:01.893900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.039973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:02.047327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-70ebe8cd-8dfc-4684-88cf-32b90722ecf4 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.165228 Dec 09 01:11:02.047890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 207/388] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:01 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:02.088384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-eebb5137-1949-431b-be1b-35be62c863fd req-6f5a75aa-28a6-49b2-8cbf-0c6d642fec10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b20e4d-c9a1-48c1-b548-a2ee5a24035e", "name": "network-vif-plugged", "status": "completed", "tag": "510d459c-7c9d-470e-af1b-5c8eb4265ba1"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:02.090193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:02.090193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:02.096830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8b2b0fa8-7f7b-4f2b-954f-229c08a1c56b tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362519 Dec 09 01:11:02.097395 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-eebb5137-1949-431b-be1b-35be62c863fd req-6f5a75aa-28a6-49b2-8cbf-0c6d642fec10 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.097503 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 182/389] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:11:01 2021] POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:02.097842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-eebb5137-1949-431b-be1b-35be62c863fd req-6f5a75aa-28a6-49b2-8cbf-0c6d642fec10 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.110137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-eebb5137-1949-431b-be1b-35be62c863fd req-6f5a75aa-28a6-49b2-8cbf-0c6d642fec10 service nova] Creating event network-vif-plugged:510d459c-7c9d-470e-af1b-5c8eb4265ba1 for instance 58b20e4d-c9a1-48c1-b548-a2ee5a24035e on hv-cinder-79053 Dec 09 01:11:02.115825 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-eebb5137-1949-431b-be1b-35be62c863fd req-6f5a75aa-28a6-49b2-8cbf-0c6d642fec10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Dec 09 01:11:02.117341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 208/390] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:02.220252 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:02.220994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:02.228111 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.228563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.229335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.229772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.382204 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:02.392990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-59c1b768-687b-45b0-803e-bec5561c151c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.176749 Dec 09 01:11:02.393732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 183/391] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:02 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:02.586298 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:02.587132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:02.593775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.595753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.596563 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.597006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.741491 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:02.749619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6be50900-2963-4276-8482-7251c3f6694c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1497 microversion: 2.1 time: 0.169561 Dec 09 01:11:02.750180 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 209/392] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:02 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:02.897950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:02.898590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:02.905029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.905467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:02.906256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:02.906713 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.043399 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:03.050655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f5a07996-b5de-451c-bf1f-a4e340b5a76c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.156845 Dec 09 01:11:03.051256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 184/393] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:02 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:03.064630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:03.065242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:03.071984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.072492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.073449 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.073895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.216075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:03.226988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d78a2b32-1bc3-4efd-ab99-39bcbf1f75ed tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.164477 Dec 09 01:11:03.228432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 210/394] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:03 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:03.410573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:03.411182 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:03.417455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.417903 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.418717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.419163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.556607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:03.565801 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-be5edfd4-5a39-4d03-a401-1e51027c44f1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.158886 Dec 09 01:11:03.566694 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 185/395] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:03 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:03.614651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:03.615155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:03.621831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.622301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.623132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.623570 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.648964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:11:03.729002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-032c7e52-948a-4dba-8120-f1ab2539a7e6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 204 len: 0 microversion: 2.1 time: 0.117522 Dec 09 01:11:03.729723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 211/396] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:11:03 2021] DELETE /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:11:03.739232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:03.739964 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:03.748893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.749186 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.749961 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:03.750423 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:03.901801 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:03.909420 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-efb3bb65-4904-4d37-a9ef-2ea22360ef14 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1503 microversion: 2.1 time: 0.175148 Dec 09 01:11:03.910017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 186/397] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:03 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:04.067420 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:04.068115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:04.074528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.074981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.075756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.076200 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.214808 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:04.234283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-62efca5e-5eea-4bae-adef-666701e4d7dd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1317 microversion: 2.1 time: 0.170567 Dec 09 01:11:04.234846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 212/398] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:04 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:04.245145 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:04.245949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:04.252146 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.252588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.253566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.254009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.401264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:04.410164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9be64245-1b12-47dc-9152-c045b89c4e03 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.169808 Dec 09 01:11:04.411209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 187/399] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:04 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:04.583293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:04.584022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:04.590549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.591077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.591923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.592448 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.729513 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:04.738567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9bdbe8c5-3987-4913-8058-cd8416f676e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.158758 Dec 09 01:11:04.739170 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 213/400] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:04 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:04.931287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:04.932643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:04.939249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.939785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:04.940651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:04.941322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.076884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:05.084202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1a81e525-bfad-47d2-937f-a506162500cf tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1503 microversion: 2.1 time: 0.157479 Dec 09 01:11:05.084743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 188/401] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:04 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:05.251271 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:05.251881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:05.257807 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.258283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.259077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.259519 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.413948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:05.424890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e83d8f7e-cf4b-4b23-bfbc-7e978e6e16bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1508 microversion: 2.1 time: 0.176881 Dec 09 01:11:05.426203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 214/402] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:05 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:05.427625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:05.428237 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:05.435920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.444797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.445890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.446345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.621149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:05.629769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dd22646d-1e87-46b6-b429-058dcba16ea1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.205870 Dec 09 01:11:05.639815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 189/403] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:05 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:05.756412 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:05.757894 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:05.765308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.766246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.767558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.768529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.849346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:05.851708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:05.859042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.862061 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.863086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:05.863609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:05.919137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'flavor' on Instance uuid d49e39a7-1ec1-4033-ae68-8088625993b3 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:11:05.961165 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:05.972010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c39ddb6b-62ff-46f1-9ba5-df1214c99d7b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.219867 Dec 09 01:11:05.972998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 215/404] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:05 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:06.065306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ec71b5a9-ab0e-406a-9e84-a55bb515a11b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action" status: 200 len: 32 microversion: 2.1 time: 0.219515 Dec 09 01:11:06.066405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 190/405] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:11:05 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:11:06.076078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:06.076713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:06.083126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.086193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.087239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.087755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.105154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:06.106313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:06.112656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.113213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.114092 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.114807 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.307277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:06.312416 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:06.317552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1eea9d16-8c2e-42f9-9fee-befe4bf9a087 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.245285 Dec 09 01:11:06.318125 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 216/406] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:06 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:06.335667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-39cc3126-4156-407f-a2bd-d31b30d1b971 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1503 microversion: 2.1 time: 0.236435 Dec 09 01:11:06.336625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 191/407] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:06 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:06.646933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:06.648074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:06.654046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.654635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.655492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.655992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.793324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:06.801377 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d74f599c-a79b-45f3-bae7-27660d2eecb2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.158271 Dec 09 01:11:06.801943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 217/408] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:06 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:06.902616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69bb1ebd-76a8-4d40-84dd-7bad5230601a"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:06.907875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:06.914217 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.914692 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.915476 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.915905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.990091 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:06.990727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:06.997434 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.997881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:06.998699 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:06.999132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.158545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:07.169490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fb7516d6-b864-4ac1-a760-a67352da05d5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.182636 Dec 09 01:11:07.170300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 218/409] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:06 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:07.234682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bff4b84f-cef8-413f-84dc-f6b168bea700 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335708 Dec 09 01:11:07.235604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 192/410] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:11:06 2021] POST /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:07.335396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:07.336041 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:07.341838 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.342293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.343120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.343820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.357041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:07.357745 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:07.363900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.364353 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.367874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.368590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.578417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:07.581986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:07.589850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-650a44df-a3c2-4a4f-a3a7-a5a989545634 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.258540 Dec 09 01:11:07.590955 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 219/411] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:07 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:07.600489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fb2f60a3-caf4-46a8-a18a-09c252924957 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 200 len: 1503 microversion: 2.1 time: 0.238892 Dec 09 01:11:07.601195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 193/412] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:07 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:07.780404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-24a0fe1b-4c13-43c9-9e0c-9f3840ce9d20 req-f2d20706-6e17-44ae-930e-aa0238336aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b28adeb-ac02-4117-b5f7-9f363afd487a", "name": "network-vif-deleted", "tag": "e20fa842-3843-4cb5-84e7-4413a72e5f3e"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:07.782102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:07.782102 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:07.790964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-24a0fe1b-4c13-43c9-9e0c-9f3840ce9d20 req-f2d20706-6e17-44ae-930e-aa0238336aba service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.791497 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-24a0fe1b-4c13-43c9-9e0c-9f3840ce9d20 req-f2d20706-6e17-44ae-930e-aa0238336aba service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.803257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-24a0fe1b-4c13-43c9-9e0c-9f3840ce9d20 req-f2d20706-6e17-44ae-930e-aa0238336aba service nova] Creating event network-vif-deleted:e20fa842-3843-4cb5-84e7-4413a72e5f3e for instance 0b28adeb-ac02-4117-b5f7-9f363afd487a on hv-cinder-79053 Dec 09 01:11:07.808066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-24a0fe1b-4c13-43c9-9e0c-9f3840ce9d20 req-f2d20706-6e17-44ae-930e-aa0238336aba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Dec 09 01:11:07.808650 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 220/413] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:07.819553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:07.820247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:07.827058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.827698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.828556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:07.828943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:07.972255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:07.980374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ffeb9211-bdcd-4f1a-8c1e-4d1621391fe8 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.165556 Dec 09 01:11:07.980946 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 194/414] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:07 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:08.189619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:08.190311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:08.197284 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.197728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.198535 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.198970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.347720 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:08.355970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-79ffef7a-3074-4eb4-84e7-20020a584f46 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.171035 Dec 09 01:11:08.356533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 221/415] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:08 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:08.607827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:08.608415 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:08.617530 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.617771 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:08.618271 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 0b28adeb-ac02-4117-b5f7-9f363afd487a] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:08.618430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.619167 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.619603 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.625728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.626181 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.627004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:08.627625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:08.642239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] HTTP exception thrown: Instance 0b28adeb-ac02-4117-b5f7-9f363afd487a could not be found. Dec 09 01:11:08.643204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Returning 404 to user: Instance 0b28adeb-ac02-4117-b5f7-9f363afd487a could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:11:08.644418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cc41841d-bc75-4cba-8f8f-6fc62ef6fd4b tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a" status: 404 len: 111 microversion: 2.1 time: 0.031053 Dec 09 01:11:08.648871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 222/416] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:08 2021] GET /compute/v2.1/servers/0b28adeb-ac02-4117-b5f7-9f363afd487a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 09 01:11:08.763694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1536099152", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "54da1fdd-8934-41b2-b4b2-5871ab439c53"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:08.765031 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:08.774834 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b2725af4-45c7-42dc-812b-6b65adde3e71 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.170688 Dec 09 01:11:08.775395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 195/417] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:08 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:08.814838 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] validate_networks() for [('54da1fdd-8934-41b2-b4b2-5871ab439c53', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:11:08.997807 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:08.998590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:09.004395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.004918 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.005775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.006309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.233588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:09.240920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8616f542-854c-43aa-8f3f-4ba3e53bcf9b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.246618 Dec 09 01:11:09.241691 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 196/418] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:08 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:09.250944 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:11:09.251361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:11:09.251827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:11:09.252226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:11:09.252629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:11:09.261745 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.262187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.263025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.263468 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.280618 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Getting quotas for project a965b3ef21e14d8787cc1b57b914f806. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:11:09.284447 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Getting quotas for user d0b8bb5afcbc4159b3f6256d8fe93997 and project a965b3ef21e14d8787cc1b57b914f806. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:11:09.295117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:11:09.297425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:11:09.343244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-dfaf75b1-af12-4e02-8eff-d58455c10961 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583135 Dec 09 01:11:09.344132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 223/419] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:11:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 09 01:11:09.355428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3a0f5c41-f126-460e-a055-fa5487d8c6ca tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:09.356155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3a0f5c41-f126-460e-a055-fa5487d8c6ca tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:09.373921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:09.374827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:09.382354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.383081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.384703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.385163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.415288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3a0f5c41-f126-460e-a055-fa5487d8c6ca tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:09.422287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3a0f5c41-f126-460e-a055-fa5487d8c6ca tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1214 microversion: 2.1 time: 0.070759 Dec 09 01:11:09.423226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 197/420] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:09 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:09.550414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:09.561250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7ea7edd6-bbdc-4a48-aad1-941bb2df1761 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.191716 Dec 09 01:11:09.562038 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 224/421] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:09 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:09.791841 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:09.792442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:09.798800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.799248 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.800026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.800503 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.943587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-14c421a7-4657-4310-afb7-cf4e2770d86b req-dac6bf24-51ab-4567-97d8-950512cc5eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceeb0702-18c0-4c51-9173-464d3c1eba87", "name": "network-vif-plugged", "status": "completed", "tag": "9403bd16-5fd9-412f-8e51-2c5dad3f9013"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:09.946573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:09.946573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:09.949529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:09.954858 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-14c421a7-4657-4310-afb7-cf4e2770d86b req-dac6bf24-51ab-4567-97d8-950512cc5eda service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:09.955377 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-14c421a7-4657-4310-afb7-cf4e2770d86b req-dac6bf24-51ab-4567-97d8-950512cc5eda service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:09.959455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ef4d8710-a897-450f-953a-c4b0c1c41937 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.171302 Dec 09 01:11:09.968053 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-14c421a7-4657-4310-afb7-cf4e2770d86b req-dac6bf24-51ab-4567-97d8-950512cc5eda service nova] Creating event network-vif-plugged:9403bd16-5fd9-412f-8e51-2c5dad3f9013 for instance ceeb0702-18c0-4c51-9173-464d3c1eba87 on hv-cinder-79053 Dec 09 01:11:09.971292 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 198/422] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:09 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:09.973741 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-14c421a7-4657-4310-afb7-cf4e2770d86b req-dac6bf24-51ab-4567-97d8-950512cc5eda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Dec 09 01:11:09.974661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 225/423] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:10.257316 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:10.257924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:10.263701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.264143 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.264913 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.265430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.397354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:10.405517 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3e498696-40fa-4067-a315-fbd1ea233fc9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.152410 Dec 09 01:11:10.406129 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 199/424] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:10 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:10.440436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:10.441143 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:10.448040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.448489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.449278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.449709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.512050 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:10.519424 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4b906667-727a-497a-bef9-d35724ad3ba6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1266 microversion: 2.1 time: 0.082973 Dec 09 01:11:10.519981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 226/425] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:10 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:10.579390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:10.579935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:10.586035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.586511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.587289 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.587720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.928931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:10.937100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9b0a13a6-f7fb-46c4-8f78-1ced8c1b9938 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.361346 Dec 09 01:11:10.937661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 200/426] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:10 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:10.978380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:10.979159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:10.985520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.985965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:10.986773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:10.987206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.122801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:11.130486 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-58fd5570-680f-4e0d-9cd8-660e42272c2e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.156839 Dec 09 01:11:11.131040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 227/427] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:10 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:11.424406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:11.424932 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:11.432179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.432627 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.433394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.433827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.537163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:11.538531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:11.544369 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.544826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.545628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.546127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.581290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:11.596534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a1507fd2-aeaa-445a-abd9-fb8097c1f355 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1318 microversion: 2.1 time: 0.176924 Dec 09 01:11:11.606458 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 201/428] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:11 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:11.621215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:11.629177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-828d823a-a729-4ed3-9f6c-763f236e021d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1272 microversion: 2.1 time: 0.095662 Dec 09 01:11:11.634773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 228/429] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:11 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:11.954799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:11.955361 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:11.962480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.962931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:11.963709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:11.964148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.095287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:12.103607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-40dd9370-dbbc-4690-aede-2f2a967009e8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.152513 Dec 09 01:11:12.104184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 202/430] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:11 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:12.147509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:12.148126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:12.155144 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.155596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.156587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.157186 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.296482 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:12.305064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-966da6c9-0803-4287-b43f-267b87956ed6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.161157 Dec 09 01:11:12.305513 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 229/431] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:12 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:12.607966 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-60e7f26a-5b8b-41e3-8b0d-77a7d0cd0621 req-6f930489-8d26-48b3-ad54-87a52a994500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36da9bb0-8fba-4c99-bf93-c805ea677d26", "tag": "fd2cce82-cac3-48b3-a16d-452d116546e4"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:12.609559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:12.609559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:11:12.614651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:12.615840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:12.616598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-60e7f26a-5b8b-41e3-8b0d-77a7d0cd0621 req-6f930489-8d26-48b3-ad54-87a52a994500 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.617050 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-60e7f26a-5b8b-41e3-8b0d-77a7d0cd0621 req-6f930489-8d26-48b3-ad54-87a52a994500 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.624120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.624888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.626031 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.626800 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.628289 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-60e7f26a-5b8b-41e3-8b0d-77a7d0cd0621 req-6f930489-8d26-48b3-ad54-87a52a994500 service nova] Creating event network-changed:fd2cce82-cac3-48b3-a16d-452d116546e4 for instance 36da9bb0-8fba-4c99-bf93-c805ea677d26 on hv-cinder-79053 Dec 09 01:11:12.633253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-60e7f26a-5b8b-41e3-8b0d-77a7d0cd0621 req-6f930489-8d26-48b3-ad54-87a52a994500 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028928 Dec 09 01:11:12.633876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 203/432] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:12.648366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:12.649164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:12.655140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.655591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.656368 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.656806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.857836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:12.878257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-36ce3e61-0e00-412b-80e1-fef1da98a8f2 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1506 microversion: 2.1 time: 0.268305 Dec 09 01:11:12.878876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 230/433] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:12 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:12.880948 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:12.890421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:12.891052 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-675833c9-03be-4ed8-b70a-56989e145e61 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.247598 Dec 09 01:11:12.891776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:12.892407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 204/434] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:12 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:12.908393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.909263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:12.910293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:12.910902 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.063903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:13.073808 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-58f34673-7089-4525-a173-286d257de5fa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1594 microversion: 2.1 time: 0.186692 Dec 09 01:11:13.074621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 231/435] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:12 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1594 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:13.121593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:13.122345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:13.130901 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.132066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.133426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.134147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.284787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:13.293533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-34594e45-73be-414b-9f1f-e98a6bce0e31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.175636 Dec 09 01:11:13.295066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 205/436] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:13 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:13.323645 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:13.324674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:13.331733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.332272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.333141 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.333655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.583940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:13.593099 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b0f0dfef-2063-4592-ac02-957989c2b063 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.274832 Dec 09 01:11:13.594150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 232/437] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:13 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:13.908250 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:13.908846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:13.918360 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.919065 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:13.919935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:13.920600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:14.174788 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:14.182547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4ab9d6e0-14a2-4372-829c-b65beb650e45 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.277940 Dec 09 01:11:14.183152 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 206/438] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:13 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:14.310561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:14.311176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:14.316995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:14.317435 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:14.318198 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:14.318674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:14.566359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:14.574633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-174902e3-0e10-4d82-a297-a19b76bb0b3d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.267873 Dec 09 01:11:14.575212 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 233/439] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:14 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:14.611417 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:14.612028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:14.618422 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:14.618880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:14.619671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:14.620117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:14.843837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:14.853236 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7936b447-2697-4a2e-a291-89649ae2df5b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.245427 Dec 09 01:11:14.853933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 207/440] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:14 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:15.200653 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:15.201331 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:15.207135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.207581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.208350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.208812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.440133 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:15.449354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4da01bdf-cfaf-4872-9446-9bd7874104c3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.252182 Dec 09 01:11:15.450010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 234/441] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:15 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:15.498783 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-12da90ce-bd5d-46bc-8562-983cd74a01b5 req-37f7d596-c68a-4f6d-a55e-b81fd07c6fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:15.500369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:15.500369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:11:15.508955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-12da90ce-bd5d-46bc-8562-983cd74a01b5 req-37f7d596-c68a-4f6d-a55e-b81fd07c6fe7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.509724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-12da90ce-bd5d-46bc-8562-983cd74a01b5 req-37f7d596-c68a-4f6d-a55e-b81fd07c6fe7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.523418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-12da90ce-bd5d-46bc-8562-983cd74a01b5 req-37f7d596-c68a-4f6d-a55e-b81fd07c6fe7 service nova] Creating event network-changed:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:11:15.531550 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-12da90ce-bd5d-46bc-8562-983cd74a01b5 req-37f7d596-c68a-4f6d-a55e-b81fd07c6fe7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036771 Dec 09 01:11:15.532153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 208/442] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:15.593145 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:15.596108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:15.603092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.603877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.604870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.605376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.798528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:15.811003 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5bd7f96d-bcd5-43a0-a4b3-e6a55b3a356d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.222462 Dec 09 01:11:15.812141 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 235/443] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:15 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:15.873434 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:15.874718 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:15.880990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.881591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:15.882676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:15.883465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:16.104343 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:16.114136 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4ce80b0a-d56e-4f79-95f1-5eb703e8b9b8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.246718 Dec 09 01:11:16.124842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 209/444] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:15 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:16.466986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:16.467677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:16.475883 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:16.476698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:16.477673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:16.478325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:16.661101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:16.670279 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b7d6da09-abbe-4781-b3fd-0a8fad88c73d tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.207147 Dec 09 01:11:16.670963 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 236/445] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:16 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:16.828843 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:16.831184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:16.839826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:16.850471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:16.852383 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:16.853061 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.003218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:17.011968 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-212f9c6f-8d85-4c67-962a-0870caaa8996 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.187620 Dec 09 01:11:17.012546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 210/446] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:16 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:17.070440 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-520718665"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:17.070983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:17.077394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.077848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.078659 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.079101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.132775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:17.133608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:17.142983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.143749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.145188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.145746 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.448965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.network.security_group_api [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Adding security group 75ee3000-b908-4248-adc8-85a4b88c7e56 to port d892a925-bdcf-416c-aa14-6cbfe415f8eb Dec 09 01:11:17.589716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:17.597738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-201c7b2c-34c3-4473-991e-a4d4384ddd5e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.469637 Dec 09 01:11:17.598564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 211/447] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:17 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:17.690069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:17.691138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:17.698723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.699272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.700142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:17.700697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:17.914305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:17.921125 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-05b4042a-3ac7-4823-bd6e-fe4aab72b66f tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.235232 Dec 09 01:11:17.921960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 212/448] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:17 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:17.961128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a4f92205-7e2d-4771-86f1-565007273233 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.895043 Dec 09 01:11:17.971899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 237/449] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:11:17 2021] POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:11:17.978328 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-b9feae93-a932-47b4-8295-8450700c1db4 req-30213aa7-6ae7-42d2-bef3-457d80a36363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:17.980092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:17.980092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:17.992328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:17.993572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:18.001105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b9feae93-a932-47b4-8295-8450700c1db4 req-30213aa7-6ae7-42d2-bef3-457d80a36363 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.006115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b9feae93-a932-47b4-8295-8450700c1db4 req-30213aa7-6ae7-42d2-bef3-457d80a36363 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.006577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.008150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.009665 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.010385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.024858 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-b9feae93-a932-47b4-8295-8450700c1db4 req-30213aa7-6ae7-42d2-bef3-457d80a36363 service nova] Creating event network-changed:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:11:18.032108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-b9feae93-a932-47b4-8295-8450700c1db4 req-30213aa7-6ae7-42d2-bef3-457d80a36363 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058918 Dec 09 01:11:18.039552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 238/450] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:18.048885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:18.049597 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:18.057011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.057588 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.058723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.059355 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.324024 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:18.336601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7252e602-2156-42ac-b81e-5ea6323949f6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.295221 Dec 09 01:11:18.337201 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 239/451] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:18 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:18.338719 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:18.349246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ac75d6dd-43b2-4acf-b4b6-073b35d3d5da tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1758 microversion: 2.1 time: 0.382225 Dec 09 01:11:18.349851 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 213/452] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:17 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1758 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:18.614773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:18.615383 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:18.622320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.622816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.623609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.624260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.775338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:18.783567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e15eec75-713c-4eed-9961-03b84303b75a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.172406 Dec 09 01:11:18.784223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 240/453] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:18 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:18.938105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:18.938706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:18.945868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.946327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:18.947144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:18.947588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:19.090407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:19.098174 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c1b279af-b388-4f1b-bf16-3a3e3cab684c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.163761 Dec 09 01:11:19.098776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 214/454] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:18 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:19.355110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:19.355504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:19.361924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:19.362389 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:19.363167 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:19.363600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:19.495663 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:19.503385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-17b209a9-c2ab-4577-92e8-b4c6012b53f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.153406 Dec 09 01:11:19.503981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 241/455] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:19 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:19.800752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:19.801572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:19.808091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:19.808544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:19.809320 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:19.809764 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:19.952954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:19.961591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d82ef119-f06e-47e9-a665-d1147eb115da tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.164489 Dec 09 01:11:19.962150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 215/456] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:19 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:20.115040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:20.115889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:20.122204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.122696 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:20.123487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.123955 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:20.252766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:20.261051 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c1372a16-5ecc-48f3-b1e9-4b53981e77e2 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.149660 Dec 09 01:11:20.261619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 242/457] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:20 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:20.523226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:20.523835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:20.530196 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.530679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:20.531492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.531960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:20.675979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:20.684314 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-88a58746-4cb3-478f-b7f2-91b2292cbfc6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.164994 Dec 09 01:11:20.684876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 216/458] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:20 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:20.978526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:20.979046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:20.985029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.985484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:20.986269 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:20.986744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.134309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:21.142077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7ef8196e-13d3-4904-a1a8-0d4e8d9135d4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.168084 Dec 09 01:11:21.142678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 243/459] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:20 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:21.278950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:21.279598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:21.289224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:21.290118 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.291154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:21.291603 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.426732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:21.434482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-978e002b-2364-4ea7-aeaa-6604ff66b798 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.160274 Dec 09 01:11:21.435037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 217/460] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:21 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:21.701668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:21.702187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:21.708287 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:21.708758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.709641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:21.710195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.851615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:21.860353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6e842266-6ae7-4e86-8833-01b65deceb02 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.162538 Dec 09 01:11:21.861136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 244/461] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:21 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:21.976855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-9059eb8a-7515-4a9a-936d-9d941c71082d req-38b31a2a-e47b-4812-a3cb-800ca4e55292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36da9bb0-8fba-4c99-bf93-c805ea677d26", "name": "network-vif-plugged", "status": "completed", "tag": "fd2cce82-cac3-48b3-a16d-452d116546e4"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:21.978602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:21.978602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:11:21.985538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9059eb8a-7515-4a9a-936d-9d941c71082d req-38b31a2a-e47b-4812-a3cb-800ca4e55292 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:21.986124 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9059eb8a-7515-4a9a-936d-9d941c71082d req-38b31a2a-e47b-4812-a3cb-800ca4e55292 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:21.997040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-9059eb8a-7515-4a9a-936d-9d941c71082d req-38b31a2a-e47b-4812-a3cb-800ca4e55292 service nova] Creating event network-vif-plugged:fd2cce82-cac3-48b3-a16d-452d116546e4 for instance 36da9bb0-8fba-4c99-bf93-c805ea677d26 on hv-cinder-79053 Dec 09 01:11:22.001693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-9059eb8a-7515-4a9a-936d-9d941c71082d req-38b31a2a-e47b-4812-a3cb-800ca4e55292 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028550 Dec 09 01:11:22.002283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 218/462] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:22.173098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:22.179880 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.195084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.196906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.201870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.203621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.259032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69bb1ebd-76a8-4d40-84dd-7bad5230601a"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:22.260664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.267655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.268520 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.273035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.273844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.362021 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Invalid volume: volume 69bb1ebd-76a8-4d40-84dd-7bad5230601a is already attached to instances: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e Dec 09 01:11:22.363349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 400 to user: Invalid volume: volume 69bb1ebd-76a8-4d40-84dd-7bad5230601a is already attached to instances: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:11:22.364180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5132530b-3509-4c68-9992-6c11ca615b3f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110393 Dec 09 01:11:22.365071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 219/463] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:11:22 2021] POST /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 09 01:11:22.376446 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:22.385242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-eeea9028-70ec-4c5a-a9f6-b01140f1b4e1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.230456 Dec 09 01:11:22.386293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 245/464] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:22 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:22.439717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:22.440231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.447018 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.447723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.448607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.449091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.450892 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:22.451514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.457631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.458086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.458903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.459346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.576581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'services' on Instance uuid 58b20e4d-c9a1-48c1-b548-a2ee5a24035e {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:11:22.602461 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:22.609999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-47ae743d-6e8b-4c3b-8dad-36742116b87c tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.162532 Dec 09 01:11:22.610803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 246/465] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:22 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:22.693224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-17a0f33a-edc7-4cf8-a0e7-d5b44a9ffaa6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments/69bb1ebd-76a8-4d40-84dd-7bad5230601a" status: 202 len: 0 microversion: 2.1 time: 0.259462 Dec 09 01:11:22.693811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 220/466] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:11:22 2021] DELETE /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments/69bb1ebd-76a8-4d40-84dd-7bad5230601a => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:11:22.702721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:22.703705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.709508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.710094 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.711519 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.712010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.740274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d8576e0d-b3ab-42ab-9fe1-b8beb9ff8bb7 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Dec 09 01:11:22.740818 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 247/467] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:22 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:22.877346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:22.878221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:22.886256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.886737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:22.887554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:22.888107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.025661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:23.033545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6a668208-9df4-407b-8258-6f879f365659 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.160233 Dec 09 01:11:23.034264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 221/468] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:22 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:23.402999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:23.403937 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:23.411258 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.411703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.412471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.413666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.554341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:23.562242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b4451c74-a9fa-4514-a5b3-92ae1aa8b958 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.163300 Dec 09 01:11:23.562836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 248/469] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:23 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:23.625540 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:23.626149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:23.632997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.633443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.634212 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.634676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.752089 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:23.753048 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:23.759757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.760211 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.760988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:23.761425 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:23.770715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:23.782738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9e030d4c-1aab-49bf-b0bc-92b6ab0e76ef tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.160594 Dec 09 01:11:23.783656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 222/470] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:23 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:23.798057 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8fc6c1a4-229d-4e5c-9a77-1eff8dc7e5be tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Dec 09 01:11:23.798664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 249/471] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:23 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:24.050307 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:24.050958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:24.057668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.058113 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.058924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.059357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.196042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:24.205435 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-05289021-4fee-43b2-9618-63ed625e5685 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.158738 Dec 09 01:11:24.206008 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 223/472] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:24 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:24.579992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:24.580643 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:24.587353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.587807 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.588604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.589058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.741108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:24.752593 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e91354b5-b732-4e5a-9452-fbdf24ee743f tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.176800 Dec 09 01:11:24.753163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 250/473] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:24 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:24.809673 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:24.812011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:24.812285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:24.813153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:24.819321 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.820153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.820277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.820380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.820644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.820742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:24.821080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.821191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:24.854192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3d9d9dcc-a8bc-4b6f-b8cb-0995718b5280 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048189 Dec 09 01:11:24.854803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 224/474] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:24 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:11:24.972275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:24.980983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-accdeb5e-6ff2-4bae-9d3e-be4636ad2378 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.173093 Dec 09 01:11:24.981755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 251/475] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:24 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:25.025167 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1394022847", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "2daaacf1-f17f-4c3f-8d5f-6ec019bc5236"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:25.074852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] validate_networks() for [('2daaacf1-f17f-4c3f-8d5f-6ec019bc5236', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:11:25.223817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:25.224341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:25.231237 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.231681 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.232449 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.232881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.464166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:25.472686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e8abcb25-988a-44fa-9ffe-d1aa70e38ac2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.252696 Dec 09 01:11:25.473264 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 252/476] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:25 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:25.524490 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:11:25.524910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:11:25.525404 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:11:25.525810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:11:25.526219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:11:25.534959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.535413 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.536252 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.536695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.553371 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:11:25.557690 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Getting quotas for user 59d2b98f1809405ab307a035062400c2 and project f6f062a4353046c9a44957550c394c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:11:25.569058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:11:25.572497 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:11:25.618344 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d3cbc723-36a3-4ae2-b42d-c425d0476704 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596844 Dec 09 01:11:25.622527 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 225/477] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:11:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:11:25.628712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-df6f117b-1498-4521-a319-c35887a9bd60 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:25.629359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-df6f117b-1498-4521-a319-c35887a9bd60 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:25.684332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-df6f117b-1498-4521-a319-c35887a9bd60 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:25.691501 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-df6f117b-1498-4521-a319-c35887a9bd60 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1218 microversion: 2.1 time: 0.066699 Dec 09 01:11:25.692067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 253/478] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:25 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:25.769265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:25.769872 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:25.776793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.777247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.778061 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:25.778525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:25.933116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:25.941083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-be0a024c-d5d8-49db-9a27-d7477c120ac7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.175472 Dec 09 01:11:25.942157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 226/479] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:25 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:25.998879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:26.000090 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:26.007274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.008328 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.009700 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.010399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.176515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:26.184494 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e7790efe-4017-4ac4-b94f-dc043f6a8f21 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1314 microversion: 2.1 time: 0.190217 Dec 09 01:11:26.184930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 254/480] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:25 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:26.489385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:26.489987 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:26.495940 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.496390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.497157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.497594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.630838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:26.639260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f80d0d01-6a5c-49f7-a8b5-4f76db1ee045 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.153469 Dec 09 01:11:26.639816 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 227/481] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:26 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:26.708325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:26.708860 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:26.715283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.715733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.716504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.716940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.776157 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:26.783603 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-04457928-d423-476d-aad9-7a84ea314b7b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1270 microversion: 2.1 time: 0.079068 Dec 09 01:11:26.784164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 255/482] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:26 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:26.961692 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:26.963294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:26.971133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.971613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:26.972812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:26.973447 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.203096 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:27.203835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:27.209292 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:27.220082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9f97810a-5490-4c63-aade-58a2d9421de8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.262858 Dec 09 01:11:27.220225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.220622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.221311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 228/483] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:26 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:27.221787 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.222236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.362570 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:27.369924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-51fa5663-dea6-4160-9fd9-35fcac8039d6 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1498 microversion: 2.1 time: 0.171193 Dec 09 01:11:27.370522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 256/484] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:27 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:27.660541 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:27.661352 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:27.668808 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.669261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.670130 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.670611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.801161 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:27.802496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:27.809239 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.809891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.810975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:27.811564 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:27.820342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:27.829490 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-65dc68f9-c96d-485f-b0ab-e0952ca5bc5f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.172613 Dec 09 01:11:27.845369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 229/485] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:27 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:28.006385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:28.016410 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e1b3a9c0-b6ca-4b04-a5e1-692541482333 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.219459 Dec 09 01:11:28.017631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 257/486] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:27 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:28.237656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:28.239109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:28.247618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.248295 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.249097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.249524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.357028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:28.358088 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:28.367882 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.368632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.369695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.370336 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.408454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:11:28.447180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:28.482009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-31dc0ba2-d895-4065-8001-881c9c201aaf tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.247831 Dec 09 01:11:28.482776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 230/487] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:28 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:28.514842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7b8c1e3c-c8ad-4e79-8cd0-c91692fd41b1 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 204 len: 0 microversion: 2.1 time: 0.161896 Dec 09 01:11:28.518786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 258/488] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:11:28 2021] DELETE /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:11:28.527785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:28.528406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:28.534685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.535123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.535914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.536374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.577015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-b8589dff-f59a-489a-b380-7d2477b63284 req-1f286c2e-89bf-4f2b-94e6-14e3289a6913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b157b7-f886-45b8-9d43-1b79d99448b5", "tag": "15269bc2-6e16-4d2e-b263-b6379a009900"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:28.578572 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:28.578572 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:28.585990 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b8589dff-f59a-489a-b380-7d2477b63284 req-1f286c2e-89bf-4f2b-94e6-14e3289a6913 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.586441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b8589dff-f59a-489a-b380-7d2477b63284 req-1f286c2e-89bf-4f2b-94e6-14e3289a6913 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.598525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-b8589dff-f59a-489a-b380-7d2477b63284 req-1f286c2e-89bf-4f2b-94e6-14e3289a6913 service nova] Creating event network-changed:15269bc2-6e16-4d2e-b263-b6379a009900 for instance c0b157b7-f886-45b8-9d43-1b79d99448b5 on hv-cinder-79053 Dec 09 01:11:28.603181 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-b8589dff-f59a-489a-b380-7d2477b63284 req-1f286c2e-89bf-4f2b-94e6-14e3289a6913 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030038 Dec 09 01:11:28.604079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 259/489] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:11:28.684629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:28.691968 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-67e868ba-7616-4750-9e0c-8b36f563c3d3 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.168236 Dec 09 01:11:28.692779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 231/490] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:28 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:28.847366 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:28.848653 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:28.857391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.857839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.858652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:28.859086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:28.988856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:28.997421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-228858d9-fbfc-4509-a552-b11724421187 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.154378 Dec 09 01:11:28.997986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 260/491] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:28 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:29.033994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:29.034630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:29.040484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.040936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.041696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.042134 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.186962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:29.195302 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7fc4125b-f4c8-47cf-bd2d-c704fe604de3 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.164312 Dec 09 01:11:29.195881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 232/492] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:29 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:29.500246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:29.500771 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:29.507712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.508164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.508946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.509907 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.643100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:29.651834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5d118918-1b51-4d80-b02f-e56b6916bb89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.155283 Dec 09 01:11:29.652468 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 261/493] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:29 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:29.709528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:29.710986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:29.717505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.718229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.719049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:29.719500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:29.850804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:29.858475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-71ffc022-b423-4064-8faf-67e3071c08db tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.152675 Dec 09 01:11:29.859040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 233/494] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:29 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:30.017295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:30.018061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:30.024887 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.025339 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.026130 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.026607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.156223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:30.164492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3bba82d6-a9aa-4e48-aec5-5826e19880ae tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.151132 Dec 09 01:11:30.165058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 262/495] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:30 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:30.211548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:30.212162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:30.218330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.218816 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.219598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.220041 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.349268 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:30.357507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6c28dbb6-3eb5-43bd-85b0-d32b8f4aeeed tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.149955 Dec 09 01:11:30.358055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 234/496] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:30 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:30.668890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:30.669419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:30.675722 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.676173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.676945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.677419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.815432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:30.823977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1cf52c07-2417-4641-8897-aaae70be2c74 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.159034 Dec 09 01:11:30.824541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 263/497] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:30 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:30.875965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:30.876581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:30.882852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.883970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:30.884848 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:30.885307 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.021496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:31.029281 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3eb26d20-7bc4-403d-8e95-f7bfadfa1e37 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.156947 Dec 09 01:11:31.029842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 235/498] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:30 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:31.181061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:31.181684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:31.187601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.188052 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.188821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.189256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.325869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:31.333625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-78568e98-d59a-43f8-8ea8-83457a888b3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.157082 Dec 09 01:11:31.334194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 264/499] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:31 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:31.374251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:31.374900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:31.380633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.381087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.381870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.382314 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.512810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:31.521325 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-95b527f1-d230-460c-af84-f5296a244b0b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.150633 Dec 09 01:11:31.521888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 236/500] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:31 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:31.841268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:31.841795 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:31.849018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.849468 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.850314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:31.850882 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:31.986660 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:31.994887 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-de16a457-e2bd-44b9-9e7c-d52e1f402763 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.157298 Dec 09 01:11:31.997335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 265/501] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:31 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:32.045991 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:32.046621 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:32.052857 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.053304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.054075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.054548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.191586 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:32.199460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6610642f-2862-4cf7-abd2-e7de57163561 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.157083 Dec 09 01:11:32.200028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 237/502] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:32 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:32.350696 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:32.351301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:32.357009 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.357452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.358226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.358683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.499105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:32.507904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ed951e90-b00c-48d2-a62d-3647084e37f9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1723 microversion: 2.1 time: 0.160879 Dec 09 01:11:32.509216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 266/503] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:32 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:32.538390 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:32.539006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:32.545260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.545791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.546657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:32.547178 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:32.691157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:32.699144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0b6c9ac8-22d9-4920-84c5-69863bd8fed6 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.164418 Dec 09 01:11:32.699714 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 238/504] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:32 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:33.016868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:33.017382 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:33.024159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.024651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.025372 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.025803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.157859 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:33.166883 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-12abd565-d47f-49fc-ba9e-9fd03946e37a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.153795 Dec 09 01:11:33.167475 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 267/505] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:33 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:33.217034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:33.217641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:33.224101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.224545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.225313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.225777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.357685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:33.364841 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8f96afba-93d1-46c1-ae71-f43f7105b3fc tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.151477 Dec 09 01:11:33.365396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 239/506] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:33 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:33.528474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:33.529085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:33.535069 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.535523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.536289 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.536726 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.667481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:33.675214 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e1069f84-94a4-4645-a9a2-2c2455914c26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1700 microversion: 2.1 time: 0.151444 Dec 09 01:11:33.675777 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 268/507] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:33 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:33.691588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a47fe14f-e50b-4c75-9fde-88d5fe306de4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:33.697583 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a47fe14f-e50b-4c75-9fde-88d5fe306de4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.698042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a47fe14f-e50b-4c75-9fde-88d5fe306de4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.716194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:33.716826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:33.723116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.723729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.724564 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.724680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a47fe14f-e50b-4c75-9fde-88d5fe306de4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Going to try to start instance {{(pid=116067) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 09 01:11:33.724975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.771679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a47fe14f-e50b-4c75-9fde-88d5fe306de4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 202 len: 0 microversion: 2.1 time: 0.083566 Dec 09 01:11:33.776262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 240/508] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:11:33 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:11:33.781645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:33.782492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:33.788669 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.789779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.790898 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:33.791448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:33.894342 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:33.903049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b206d5bd-abd1-4318-886a-2968adbc4863 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.190634 Dec 09 01:11:33.904095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 269/509] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:33 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:33.962031 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:33.970283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-137d45d2-11bd-46ce-bcbb-69c9e3153abd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1709 microversion: 2.1 time: 0.192556 Dec 09 01:11:33.971368 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 241/510] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:33 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1709 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:34.184323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:34.184877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:34.191809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.192309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.193248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.193686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.332173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:34.344155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3568f956-3713-4550-8d9e-033af18ced42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.163882 Dec 09 01:11:34.344742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 270/511] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:34 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:34.382488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:34.383702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:34.389800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.390253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.391088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.391555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.577036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:34.584563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3f52850c-9279-4066-aa80-cce1c7d55d51 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1504 microversion: 2.1 time: 0.206912 Dec 09 01:11:34.585136 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 242/512] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:34 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:34.921146 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:34.921923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:34.934869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.935403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.936318 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.936839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.989687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:34.990311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:34.997200 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:34.997994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:34.999721 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.000326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.145110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:35.153113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-60782e3a-8395-4454-91fb-7e8c5de20be2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.235674 Dec 09 01:11:35.153688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 271/513] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:34 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:35.163442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-1f62e1ee-1837-432d-9362-23133d1ee13d req-ea7f184d-60b8-476e-a6f4-3a022ff673e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36da9bb0-8fba-4c99-bf93-c805ea677d26", "name": "network-vif-deleted", "tag": "fd2cce82-cac3-48b3-a16d-452d116546e4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:35.165108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:35.165108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:35.171737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-1f62e1ee-1837-432d-9362-23133d1ee13d req-ea7f184d-60b8-476e-a6f4-3a022ff673e3 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.172184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-1f62e1ee-1837-432d-9362-23133d1ee13d req-ea7f184d-60b8-476e-a6f4-3a022ff673e3 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.183759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-1f62e1ee-1837-432d-9362-23133d1ee13d req-ea7f184d-60b8-476e-a6f4-3a022ff673e3 service nova] Creating event network-vif-deleted:fd2cce82-cac3-48b3-a16d-452d116546e4 for instance 36da9bb0-8fba-4c99-bf93-c805ea677d26 on hv-cinder-79053 Dec 09 01:11:35.188613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-1f62e1ee-1837-432d-9362-23133d1ee13d req-ea7f184d-60b8-476e-a6f4-3a022ff673e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028597 Dec 09 01:11:35.189168 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:35.189322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 272/514] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:35.198142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-28a64a5b-ae64-41a9-ae36-7ba057cb9ac7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1709 microversion: 2.1 time: 0.212823 Dec 09 01:11:35.198726 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 243/515] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:34 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:35.361320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:35.362035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:35.369477 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.369916 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.370732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.371162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.505897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:35.514643 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-00d99cb8-6b8b-413a-88f7-71e5aeacda73 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.157310 Dec 09 01:11:35.515223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 273/516] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:35 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:35.602048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:35.602819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:35.609169 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.609614 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.610402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.610838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.640744 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:35.641110 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:35.641554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lazy-loading 'fault' on Instance uuid 36da9bb0-8fba-4c99-bf93-c805ea677d26 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:11:35.688155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b8bb5afcbc4159b3f6256d8fe93997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a965b3ef21e14d8787cc1b57b914f806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:35.698894 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dd2dc056-91ba-40f7-857b-95fb62355616 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 200 len: 1304 microversion: 2.1 time: 0.097686 Dec 09 01:11:35.698894 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 244/517] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:35 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:36.172129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:36.172129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:36.177113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.177678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.178502 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.178941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.221608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:36.221608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:36.222852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.223313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.224107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.224542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.349887 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:36.357622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-11cd1fe3-3fee-4510-9754-7f8dbaf28a65 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.191604 Dec 09 01:11:36.358202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 274/518] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:36 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:36.394911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:36.404385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f7fe08f4-087e-45a3-9d9b-63dd28396289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1713 microversion: 2.1 time: 0.192201 Dec 09 01:11:36.404958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 245/519] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:36 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1713 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:11:36.532279 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:36.532881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:36.539251 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.539827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.540585 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.541019 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.714341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:36.715018 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] [instance: 36da9bb0-8fba-4c99-bf93-c805ea677d26] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:36.721710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.722488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.723505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:36.723954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:36.754424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] HTTP exception thrown: Instance 36da9bb0-8fba-4c99-bf93-c805ea677d26 could not be found. Dec 09 01:11:36.755311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] Returning 404 to user: Instance 36da9bb0-8fba-4c99-bf93-c805ea677d26 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:11:36.756517 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7772074b-3443-4116-b9c2-923e18317e64 tempest-VolumesActionsTest-1337157082 tempest-VolumesActionsTest-1337157082-project] 10.222.0.23 "GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26" status: 404 len: 111 microversion: 2.1 time: 0.047349 Dec 09 01:11:36.757076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 246/520] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:36 2021] GET /compute/v2.1/servers/36da9bb0-8fba-4c99-bf93-c805ea677d26 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 09 01:11:36.904191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:36.912300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-755193c8-1bee-4314-84af-631435f9e4c4 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1568 microversion: 2.1 time: 0.383476 Dec 09 01:11:36.912874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 275/521] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:36 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:37.374335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:37.374992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:37.381000 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:37.381452 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:37.382435 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:37.382880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:37.551447 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:37.559281 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f5b00057-76c6-400d-94fb-50421fb9803c tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.188500 Dec 09 01:11:37.559843 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 247/522] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:37 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:37.928734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:37.929353 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:37.935732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:37.936184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:37.937088 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:37.937526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.089139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:38.097954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8c270bd9-b383-4e80-ba9b-573da8205029 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1548 microversion: 2.1 time: 0.172751 Dec 09 01:11:38.098863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 276/523] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:37 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:38.115023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:38.115577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:38.123207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.123655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.124451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.124887 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.209139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] HTTP exception thrown: Cannot 'detach_volume' instance d49e39a7-1ec1-4033-ae68-8088625993b3 while it is in vm_state rescued Dec 09 01:11:38.209820 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Returning 409 to user: Cannot 'detach_volume' instance d49e39a7-1ec1-4033-ae68-8088625993b3 while it is in vm_state rescued {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:11:38.210805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7bb50669-8942-4253-bdf5-c4e5891c4596 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments/b341ef30-d5d6-4f2e-94f4-e1d18a282472" status: 409 len: 152 microversion: 2.1 time: 0.099633 Dec 09 01:11:38.211460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 248/524] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:11:38 2021] DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments/b341ef30-d5d6-4f2e-94f4-e1d18a282472 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 09 01:11:38.220820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:38.221382 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:38.227283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.227734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.228617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.229064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.291721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-175a735f-19bb-4441-b669-5c05b7a2b28a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action" status: 202 len: 0 microversion: 2.1 time: 0.074688 Dec 09 01:11:38.295474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 277/525] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:11:38 2021] POST /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:11:38.300330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:38.300935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:38.306921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.307407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.308254 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.308668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.437437 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:38.445103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eb350a9b-d7a6-422d-98bd-e5d46cd2c74b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.148384 Dec 09 01:11:38.445645 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 249/526] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:38 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:38.576864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:38.577564 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:38.583550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.583999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.584779 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:38.585214 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:38.731124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:38.738613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7fd4994a-72c4-44f4-aa60-3b91b6ebc38f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.165810 Dec 09 01:11:38.739177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 278/527] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:38 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:39.461643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:39.462424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:39.469025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:39.469460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:39.470230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:39.470699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:39.600102 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:39.608484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dbd25626-f5ff-4487-a4cc-9b87c5315c82 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.150486 Dec 09 01:11:39.609038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 250/528] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:39 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:39.755199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:39.755891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:39.762931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:39.763386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:39.764184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:39.764625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:39.897930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:39.906471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a5f6e459-d65f-4e45-b96c-b4c88e3f00d9 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.154838 Dec 09 01:11:39.907090 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 279/529] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:39 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:40.624887 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:40.625484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:40.631694 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:40.632139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:40.632911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:40.633344 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:40.760821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:40.768454 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-836b5b59-6fa3-42a5-83c5-7827f6c39050 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.147138 Dec 09 01:11:40.769007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 251/530] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:40 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:40.923791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:40.924411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:40.930731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:40.931174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:40.932138 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:40.932809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:41.062623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:41.070062 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0c190fac-f2e0-4b97-a712-65d6d128dddb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.149871 Dec 09 01:11:41.070744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 280/531] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:40 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:41.785725 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:41.786335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:41.793212 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:41.793661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:41.794468 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:41.794909 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:41.929902 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:41.937687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b80c0bb4-0403-4f40-8b66-3f2257171021 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.155609 Dec 09 01:11:41.938234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 252/532] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:41 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:42.087870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:42.088596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:42.095052 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:42.095447 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:42.096256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:42.096704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:42.232076 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:42.240551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-56d83d75-ba52-4e57-872a-1a655d6f08bf tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.157168 Dec 09 01:11:42.241121 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 281/533] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:42 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:42.954350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:42.954977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:42.961229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:42.961702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:42.962832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:42.963013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:43.108403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:43.116960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7aa9ce19-ffd0-47fa-acc2-5a261e031214 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.166130 Dec 09 01:11:43.117720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 253/534] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:42 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:43.256116 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-93d61bbb-2d6f-4af7-91a0-4e9aefbd9c52 req-cfee0546-8dd3-4bc9-800c-2a253c8b03f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b157b7-f886-45b8-9d43-1b79d99448b5", "name": "network-vif-plugged", "status": "completed", "tag": "15269bc2-6e16-4d2e-b263-b6379a009900"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:43.257719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:11:43.257719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:11:43.263010 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:43.263947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:43.276149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:43.276703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:43.278921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:43.282448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:43.284826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-93d61bbb-2d6f-4af7-91a0-4e9aefbd9c52 req-cfee0546-8dd3-4bc9-800c-2a253c8b03f7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:43.285588 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-93d61bbb-2d6f-4af7-91a0-4e9aefbd9c52 req-cfee0546-8dd3-4bc9-800c-2a253c8b03f7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:43.308785 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-93d61bbb-2d6f-4af7-91a0-4e9aefbd9c52 req-cfee0546-8dd3-4bc9-800c-2a253c8b03f7 service nova] Creating event network-vif-plugged:15269bc2-6e16-4d2e-b263-b6379a009900 for instance c0b157b7-f886-45b8-9d43-1b79d99448b5 on hv-cinder-79053 Dec 09 01:11:43.322651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-93d61bbb-2d6f-4af7-91a0-4e9aefbd9c52 req-cfee0546-8dd3-4bc9-800c-2a253c8b03f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069007 Dec 09 01:11:43.326212 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 282/535] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:43.489285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:43.506085 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0c9c8d48-2ff4-4b53-ab1b-068290751828 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.246486 Dec 09 01:11:43.506948 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 254/536] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:43 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:43.989046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8db9e70-c0c0-4843-812e-79d8d0e092c3", "device": "/dev/sdb"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:43.990861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:44.000216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.001117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.002332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.003297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.136432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:44.138082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:44.145605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.146941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.147877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.148445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.322911 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:44.332084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-154a405a-b56b-4e73-8923-f527c57c40d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1556 microversion: 2.1 time: 0.200589 Dec 09 01:11:44.333832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 255/537] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:44 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:44.395632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ac7708b2-b5a7-4f3e-b0b4-82cd03c62d4a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "POST /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410510 Dec 09 01:11:44.398800 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 283/538] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:11:43 2021] POST /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:44.525485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:44.526596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:44.540055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.540499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.541296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:44.541733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:44.718453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:44.748537 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e178f57c-6626-4285-a731-07ebc3a36f44 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1318 microversion: 2.1 time: 0.228705 Dec 09 01:11:44.769303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 256/539] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:44 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:45.351238 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:45.351928 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:45.358637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.359085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.359860 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.360293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.503558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:45.511724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-27da619f-7935-4fdd-8d5e-0011757b2226 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1562 microversion: 2.1 time: 0.164925 Dec 09 01:11:45.512283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 284/540] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:45 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:45.591997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:45.592842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:45.598982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.599438 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.600215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.600654 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.688723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'services' on Instance uuid d49e39a7-1ec1-4033-ae68-8088625993b3 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:11:45.771187 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-23f59420-1205-4d3e-a43a-bfdc3091a661 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments/b341ef30-d5d6-4f2e-94f4-e1d18a282472" status: 202 len: 0 microversion: 2.1 time: 0.183637 Dec 09 01:11:45.771802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 257/541] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:11:45 2021] DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments/b341ef30-d5d6-4f2e-94f4-e1d18a282472 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:11:45.776476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:45.777552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:45.786018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.786776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.788348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.789279 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.799923 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:45.801346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:45.808595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.809402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.810300 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:45.811009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:45.857388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-138a36eb-c9c3-4928-a3cd-5ce8b2d0bcd0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080667 Dec 09 01:11:45.858461 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 258/542] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:45 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:45.947780 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:11:45.956634 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-aed6502e-acfe-4e7b-85e2-f0914e625b9b tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1508 microversion: 2.1 time: 0.183773 Dec 09 01:11:45.959878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 285/543] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:11:45 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:11:46.869686 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:46.870717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:46.876940 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:46.877397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:46.878180 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:46.878652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:46.910606 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b9eae701-526e-4078-98a4-6b64b59ebfd3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Dec 09 01:11:46.911184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 259/544] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:46 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:47.344796 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e721ad2-f840-4ab8-9d21-0f0574dc9277"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:11:47.348314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:47.363485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:47.364552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:47.365721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:47.366980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:47.703173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9deaa5a1-0aa8-46e4-b976-3e1eea39da22 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "POST /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363526 Dec 09 01:11:47.704193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 286/545] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:11:47 2021] POST /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:47.922487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:47.923491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:47.931094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:47.931843 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:47.932815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:47.933428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:47.965363 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d94dd6d0-4699-4f60-978a-339837145c7e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046708 Dec 09 01:11:47.966215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 260/546] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:47 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:48.981555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:48.982755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:48.991528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:48.992330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:48.994728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:48.995691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:49.035033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d8ba37cd-92b8-4a07-97a5-414ba038cd8e tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058983 Dec 09 01:11:49.040677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 287/547] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:48 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:50.047359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:50.048443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:50.057099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:50.057953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:50.059094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:50.059547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:50.100988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-232de2d0-3856-4bca-a515-4a82e9173cd5 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057720 Dec 09 01:11:50.101840 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 261/548] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:50 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:51.112709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:51.114576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:51.122010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:51.122490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:51.123282 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:51.123713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:51.159781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6de726f4-a309-4725-81fa-7bbf6c86218b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050867 Dec 09 01:11:51.160685 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 288/549] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:51 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:52.173781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:52.176538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:52.184829 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:52.185636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:52.186583 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:52.187369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:52.222263 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b8479610-ed3d-4570-8591-6683d1b3720d tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053335 Dec 09 01:11:52.223781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 262/550] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:52 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:53.237499 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:53.241641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:53.261123 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:53.263613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:53.265731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:53.266313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:53.316521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ff066067-dd75-4595-ad5a-91817878d67a tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085860 Dec 09 01:11:53.317247 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 289/551] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:53 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:54.328190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:54.329105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:54.335588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:54.336050 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:54.337826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:54.338501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:54.370154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5d3ecee0-aae8-425b-ae84-d244336878d3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Dec 09 01:11:54.371007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 263/552] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:54 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:55.385775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:55.388284 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:55.396821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:55.397611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:55.398452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:55.398954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:55.435554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a9ad9a1e-557c-4017-b273-63066d259a45 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057324 Dec 09 01:11:55.436913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 290/553] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:55 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:56.450388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:56.452033 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:56.459917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:56.460482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:56.462099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:56.462970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:56.496816 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3fa705e3-2e7c-4b08-b3e6-0188372ccda1 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052458 Dec 09 01:11:56.499064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 264/554] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:56 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:57.509407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:57.510330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:57.519252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:57.519562 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:57.520573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:57.521268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:57.562205 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9a9f6bb8-fa5a-4090-b69e-316f574b3148 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056725 Dec 09 01:11:57.566234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 291/555] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:57 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:11:58.590456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:11:58.591391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:11:58.597902 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:58.598573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:58.604534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:11:58.605006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:11:58.633894 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1886f28b-5070-49a4-aca4-bde55a1f3414 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064101 Dec 09 01:11:58.634526 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 265/556] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:11:58 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:12:07.220140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:07.220709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:07.227991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.228443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:07.229260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.229751 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:07.254706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:07.331168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cda85b01-77bc-4af9-ac51-720f06903d42 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 204 len: 0 microversion: 2.1 time: 0.114625 Dec 09 01:12:07.331963 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 292/557] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:07 2021] DELETE /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:07.340697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:07.341308 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:07.347898 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.348346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:07.349196 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.349815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:07.487339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:07.494631 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a94dacd1-81f8-42d0-ac2d-e5e7dc62d7c3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1507 microversion: 2.1 time: 0.158516 Dec 09 01:12:07.495188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 266/558] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:07 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:07.950389 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:07.951064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:07.956950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.957405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:07.958189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:07.958651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:08.040848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'services' on Instance uuid c0b157b7-f886-45b8-9d43-1b79d99448b5 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:08.128240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1808bb6b-3f1f-4d5b-9d1f-b44d36da5edd tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments/1e721ad2-f840-4ab8-9d21-0f0574dc9277" status: 202 len: 0 microversion: 2.1 time: 0.181837 Dec 09 01:12:08.128898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 293/559] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:12:07 2021] DELETE /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments/1e721ad2-f840-4ab8-9d21-0f0574dc9277 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:12:08.138352 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:08.139667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:08.145559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:08.146101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:08.146982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:08.147509 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:08.182113 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eff3ceb9-ddca-4d67-b2ab-b33cb11c2315 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Dec 09 01:12:08.185953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 267/560] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:12:08 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:08.512431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:08.513617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:08.520064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:08.520652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:08.521971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:08.522594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:08.686166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:08.693568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e615bc12-eb36-4003-92d2-4cdc32c37ca0 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1507 microversion: 2.1 time: 0.186277 Dec 09 01:12:08.694222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 294/561] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:08 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:09.194233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:09.195954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:09.203106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:09.203687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:09.204582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:09.205160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:09.243510 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eabd641b-ecb5-421f-80ef-2e1f80660ec2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053937 Dec 09 01:12:09.244462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 268/562] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:12:09 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:09.710389 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:09.711188 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:09.717843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:09.718294 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:09.719112 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:09.719556 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:09.860230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:09.875476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b0c7e87a-3a96-4b4b-a572-fa4dcdc8d4fe tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1507 microversion: 2.1 time: 0.160787 Dec 09 01:12:09.876117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 295/563] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:09 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:10.255478 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:10.256326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:10.262762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.263337 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:10.264115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.264551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:10.285976 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:10.286514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:10.293166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.293647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:10.294563 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.295032 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:10.297342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3ecf438f-2316-4433-8d79-b6881eee2826 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045947 Dec 09 01:12:10.298113 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 269/564] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:12:10 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:12:10.388226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lazy-loading 'services' on Instance uuid ceeb0702-18c0-4c51-9173-464d3c1eba87 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:10.461110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9fa5b2b0-8526-4550-85ef-35a96a2782a1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87/os-volume_attachments/e8db9e70-c0c0-4843-812e-79d8d0e092c3" status: 202 len: 0 microversion: 2.1 time: 0.178586 Dec 09 01:12:10.461867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 296/565] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:12:10 2021] DELETE /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87/os-volume_attachments/e8db9e70-c0c0-4843-812e-79d8d0e092c3 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:12:10.900786 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:10.902225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:10.911890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.912711 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:10.915105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:10.916245 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.067521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:11.074816 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-71062e5c-24cb-4b06-aefd-050a10496905 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1507 microversion: 2.1 time: 0.182001 Dec 09 01:12:11.075373 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 270/566] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:10 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:11.487071 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:11.487649 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:11.495153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:11.495958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.496863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:11.497306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.528673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:11.612756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d0f378e7-81f3-421c-b8c8-624928efab62 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 204 len: 0 microversion: 2.1 time: 0.129882 Dec 09 01:12:11.613766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 297/567] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:11 2021] DELETE /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:11.622076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:11.622805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:11.629287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:11.629870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.630777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:11.631303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.765544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:11.772999 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-25867baf-f79a-4d57-a3fe-23072795caab tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1514 microversion: 2.1 time: 0.154868 Dec 09 01:12:11.773594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 271/568] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:11 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:11.895278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-a74fa667-d38d-42ea-a180-4552254bed8f req-bb8c6c20-a0d8-42d8-aab0-7f7a71afce13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617dfc6-89b9-4d31-b4bc-9c150258059d", "name": "network-vif-deleted", "tag": "8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:11.896849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:11.896849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:12:11.903735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a74fa667-d38d-42ea-a180-4552254bed8f req-bb8c6c20-a0d8-42d8-aab0-7f7a71afce13 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:11.904179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a74fa667-d38d-42ea-a180-4552254bed8f req-bb8c6c20-a0d8-42d8-aab0-7f7a71afce13 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:11.930037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a74fa667-d38d-42ea-a180-4552254bed8f req-bb8c6c20-a0d8-42d8-aab0-7f7a71afce13 service nova] Creating event network-vif-deleted:8afbc1a2-60e7-4fcf-8225-5f5f426ef1bb for instance 4617dfc6-89b9-4d31-b4bc-9c150258059d on hv-cinder-79053 Dec 09 01:12:11.935119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-a74fa667-d38d-42ea-a180-4552254bed8f req-bb8c6c20-a0d8-42d8-aab0-7f7a71afce13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044012 Dec 09 01:12:11.935725 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 298/569] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:12.092317 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:12.093039 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:12.099045 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.099501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.100494 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.100927 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.134262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.134682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.135142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'fault' on Instance uuid 4617dfc6-89b9-4d31-b4bc-9c150258059d {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:12.180648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:12.187869 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c22b3d79-a06e-48e7-9195-002036039460 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 200 len: 1311 microversion: 2.1 time: 0.099504 Dec 09 01:12:12.188428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 272/570] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:12 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:12.628297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:12.628930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:12.635369 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.635810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.636579 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.637008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.661010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:12.733360 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ace1c253-0e6e-4e99-97f1-5cc6dc568556 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 204 len: 0 microversion: 2.1 time: 0.109100 Dec 09 01:12:12.734024 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 299/571] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:12 2021] DELETE /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:12.742082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:12.742737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:12.748932 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.749381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.750162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.750641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.789623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:12.790320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:12.796146 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.796613 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.797388 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:12.797816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:12.920328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:12.932973 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cd9a2c83-61a5-4b5e-b681-4d35d364aa3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1512 microversion: 2.1 time: 0.194440 Dec 09 01:12:12.934127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 273/572] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:12 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:12.968995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:12.978012 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-02fb44c3-1525-46cf-a097-198bf90f3385 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1514 microversion: 2.1 time: 0.192436 Dec 09 01:12:12.978655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 300/573] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:12 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:13.205236 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:13.205768 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: 4617dfc6-89b9-4d31-b4bc-9c150258059d] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:13.211710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.212165 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.212942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.213386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.227127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] HTTP exception thrown: Instance 4617dfc6-89b9-4d31-b4bc-9c150258059d could not be found. Dec 09 01:12:13.227710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Returning 404 to user: Instance 4617dfc6-89b9-4d31-b4bc-9c150258059d could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:13.228515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f45e36fd-5fbb-449c-82e7-df3cd3b5e7cc tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d" status: 404 len: 111 microversion: 2.1 time: 0.027072 Dec 09 01:12:13.229040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 274/574] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:13 2021] GET /compute/v2.1/servers/4617dfc6-89b9-4d31-b4bc-9c150258059d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:13.236706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:13.237297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:13.243960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.244419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.245196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.245637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.271794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:13.344527 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-423be427-f397-4123-9b70-d09d9ce35238 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 204 len: 0 microversion: 2.1 time: 0.111111 Dec 09 01:12:13.345110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 301/575] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:13 2021] DELETE /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:13.353913 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:13.354563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:13.360471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.360921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.361717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.362138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.490844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:13.498505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-649e3594-4985-426b-b7bc-7d147a62b32b tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.148755 Dec 09 01:12:13.499071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 275/576] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:13 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:13.951256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:13.951990 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:13.958074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.958564 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.959345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:13.959776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:13.995634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:13.996264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:14.002619 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:14.003074 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:14.003860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:14.004301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:14.139924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:14.147677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-196585ae-de9f-45cd-a3b9-187a75ab1d29 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1512 microversion: 2.1 time: 0.200635 Dec 09 01:12:14.148921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 302/577] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:13 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:14.185015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:14.192462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-74ed3f9e-9f56-4622-8aa3-a5db758e76ec tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1514 microversion: 2.1 time: 0.200964 Dec 09 01:12:14.193018 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 276/578] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:13 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:14.515912 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:14.516558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:14.523998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:14.524649 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:14.525454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:14.525899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:14.658992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:14.666631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e99106de-4b3d-4901-abbb-86b8cfd425e3 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.154420 Dec 09 01:12:14.667206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 303/579] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:14 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:15.021850 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-49bab2fb-1cc5-4129-b2fa-3fb66a29b68d req-29207933-f422-49d3-a640-6fcca0dea76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b157b7-f886-45b8-9d43-1b79d99448b5", "name": "network-vif-deleted", "tag": "15269bc2-6e16-4d2e-b263-b6379a009900"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:15.023803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:15.023803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:15.032188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-49bab2fb-1cc5-4129-b2fa-3fb66a29b68d req-29207933-f422-49d3-a640-6fcca0dea76d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.032774 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-49bab2fb-1cc5-4129-b2fa-3fb66a29b68d req-29207933-f422-49d3-a640-6fcca0dea76d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.044658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-49bab2fb-1cc5-4129-b2fa-3fb66a29b68d req-29207933-f422-49d3-a640-6fcca0dea76d service nova] Creating event network-vif-deleted:15269bc2-6e16-4d2e-b263-b6379a009900 for instance c0b157b7-f886-45b8-9d43-1b79d99448b5 on hv-cinder-79053 Dec 09 01:12:15.049453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-49bab2fb-1cc5-4129-b2fa-3fb66a29b68d req-29207933-f422-49d3-a640-6fcca0dea76d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031449 Dec 09 01:12:15.050051 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 277/580] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:15.165876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:15.166676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:15.173026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.173488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.174315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.174799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.210022 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:15.212295 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:15.219640 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.220397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.221688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.222127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.260545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.260896 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.261357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'fault' on Instance uuid c0b157b7-f886-45b8-9d43-1b79d99448b5 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:15.323030 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:15.332092 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-71fb2328-8271-41d6-b41e-fdf4779234db tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 200 len: 1308 microversion: 2.1 time: 0.126094 Dec 09 01:12:15.332665 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 278/581] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:15 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:15.357464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:15.364691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ce85c08b-6e17-40ab-b34b-f0e95be6648d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1512 microversion: 2.1 time: 0.203327 Dec 09 01:12:15.365253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 304/582] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:15 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:15.683696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:15.684339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:15.690119 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.690638 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.691415 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:15.691853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:15.858279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:15.866294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c6048316-1c5c-448d-a21f-af77224150dd tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.186199 Dec 09 01:12:15.868009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 279/583] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:15 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:16.349048 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:16.350456 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: c0b157b7-f886-45b8-9d43-1b79d99448b5] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:16.359132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.359607 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.360563 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.360786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.374765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Instance c0b157b7-f886-45b8-9d43-1b79d99448b5 could not be found. Dec 09 01:12:16.375424 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 404 to user: Instance c0b157b7-f886-45b8-9d43-1b79d99448b5 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:16.376242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1479ae48-ab17-4d7a-ada3-a8c1944023a4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5" status: 404 len: 111 microversion: 2.1 time: 0.031233 Dec 09 01:12:16.378036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 305/584] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:16 2021] GET /compute/v2.1/servers/c0b157b7-f886-45b8-9d43-1b79d99448b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:16.383213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:16.384327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:16.391264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.391889 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.392698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.393162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.426674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.427125 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.427578 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lazy-loading 'fault' on Instance uuid ceeb0702-18c0-4c51-9173-464d3c1eba87 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:16.471155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:16.483306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-496adf22-336b-4626-aa4b-31988cf940ce tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 200 len: 1308 microversion: 2.1 time: 0.103747 Dec 09 01:12:16.483793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 280/585] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:16 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:16.884490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:16.885094 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:16.890906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.891350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:16.892113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:16.892546 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:17.022270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:17.029557 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-72582258-8c5a-4644-a507-cedefa3b32ab tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.149387 Dec 09 01:12:17.030112 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 306/586] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:16 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:17.064979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-c69bf8e6-6d11-4b41-96de-c4c788992af8 req-1d28613e-a200-41a3-a9e8-cddca95d9555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceeb0702-18c0-4c51-9173-464d3c1eba87", "name": "network-vif-deleted", "tag": "9403bd16-5fd9-412f-8e51-2c5dad3f9013"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:17.066579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:17.066579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:17.074251 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c69bf8e6-6d11-4b41-96de-c4c788992af8 req-1d28613e-a200-41a3-a9e8-cddca95d9555 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:17.074722 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c69bf8e6-6d11-4b41-96de-c4c788992af8 req-1d28613e-a200-41a3-a9e8-cddca95d9555 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:17.084798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-c69bf8e6-6d11-4b41-96de-c4c788992af8 req-1d28613e-a200-41a3-a9e8-cddca95d9555 service nova] Creating event network-vif-deleted:9403bd16-5fd9-412f-8e51-2c5dad3f9013 for instance ceeb0702-18c0-4c51-9173-464d3c1eba87 on hv-cinder-79053 Dec 09 01:12:17.089833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-c69bf8e6-6d11-4b41-96de-c4c788992af8 req-1d28613e-a200-41a3-a9e8-cddca95d9555 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028453 Dec 09 01:12:17.090485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 281/587] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:17.500019 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:17.500666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: ceeb0702-18c0-4c51-9173-464d3c1eba87] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:17.506970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:17.507458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:17.508243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:17.508682 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:17.521810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] HTTP exception thrown: Instance ceeb0702-18c0-4c51-9173-464d3c1eba87 could not be found. Dec 09 01:12:17.522447 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Returning 404 to user: Instance ceeb0702-18c0-4c51-9173-464d3c1eba87 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:17.523430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-60061fcf-66ef-4be3-8a38-f6782609e620 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87" status: 404 len: 111 microversion: 2.1 time: 0.026950 Dec 09 01:12:17.523987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 307/588] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:17 2021] GET /compute/v2.1/servers/ceeb0702-18c0-4c51-9173-464d3c1eba87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:18.047094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:18.047788 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:18.053761 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:18.054274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:18.055087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:18.055518 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:18.189175 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:18.196991 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5dbfda32-98a0-46e1-aaf2-28062317cac8 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.154342 Dec 09 01:12:18.197546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 282/589] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:18 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:19.213439 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:19.214074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:19.220737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:19.221183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:19.221957 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:19.222408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:19.362554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:19.371840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-12910db0-6b5f-456a-994b-8edffff808d6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.162053 Dec 09 01:12:19.372546 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 308/590] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:19 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:20.388613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:20.389220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:20.395515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:20.395971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:20.396751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:20.397194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:20.530311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:20.538283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-02952c4a-90fb-488e-bb7e-8947304fab32 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.153276 Dec 09 01:12:20.539504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 283/591] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:20 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:21.555320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:21.555971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:21.562668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:21.563122 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:21.563901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:21.564337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:21.693235 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:21.700966 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d03243e1-f98f-4480-bb71-4b82f6de2fb7 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.149295 Dec 09 01:12:21.701522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 309/592] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:21 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:22.327632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:22.328581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:22.334847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.335304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.336138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.336583 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.405492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-659b9176-f379-460c-97c5-fe8373daf803 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.081279 Dec 09 01:12:22.406060 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 284/593] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:12:22 2021] POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:12:22.414052 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:22.415261 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:22.421030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.421475 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.422244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.422706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.574866 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:22.582568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9fc4534a-c753-44dc-a0be-e70978bfdf98 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1750 microversion: 2.1 time: 0.172122 Dec 09 01:12:22.583129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 310/594] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:22 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:22.718467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:22.719105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:22.725172 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.725627 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.726429 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:22.727420 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:22.863826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:22.870992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1b531c5a-5c74-4780-a070-2291762da7e6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.156872 Dec 09 01:12:22.871546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 285/595] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:22 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:23.600135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:23.600754 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:23.607218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:23.607680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:23.608471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:23.608910 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:23.761550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:23.769843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-709277e2-da9e-4181-8aa3-b7f3225a40ef tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1750 microversion: 2.1 time: 0.173396 Dec 09 01:12:23.770606 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 311/596] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:23 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:23.887293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:23.887846 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:23.894222 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:23.894709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:23.895492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:23.895982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.125091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:24.134680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c8ff6b7c-9681-4b87-8a69-064a670ef316 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1522 microversion: 2.1 time: 0.249159 Dec 09 01:12:24.135510 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 286/597] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:23 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:24.495178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-dbc7a5d1-48bf-4d52-9625-4079cd3c1fb1 req-a9c06330-5391-4c15-a2ec-206555303d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49e39a7-1ec1-4033-ae68-8088625993b3", "name": "network-vif-deleted", "tag": "1576c59c-6b4a-44f7-a7f1-368b59dcd4ff"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:24.496820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:24.496820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:12:24.504768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-dbc7a5d1-48bf-4d52-9625-4079cd3c1fb1 req-a9c06330-5391-4c15-a2ec-206555303d9f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:24.505214 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-dbc7a5d1-48bf-4d52-9625-4079cd3c1fb1 req-a9c06330-5391-4c15-a2ec-206555303d9f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.522510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-dbc7a5d1-48bf-4d52-9625-4079cd3c1fb1 req-a9c06330-5391-4c15-a2ec-206555303d9f service nova] Creating event network-vif-deleted:1576c59c-6b4a-44f7-a7f1-368b59dcd4ff for instance d49e39a7-1ec1-4033-ae68-8088625993b3 on hv-cinder-79053 Dec 09 01:12:24.528897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-dbc7a5d1-48bf-4d52-9625-4079cd3c1fb1 req-a9c06330-5391-4c15-a2ec-206555303d9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038163 Dec 09 01:12:24.529382 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 312/598] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:24.788652 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:24.789276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:24.796291 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:24.796753 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.798058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:24.798546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.851684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:24.853939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:24.863162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:24.863697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.864606 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:24.865135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:24.895844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:24.991628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-88be305b-b0f1-445d-afac-09cadeda705e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 204 len: 0 microversion: 2.1 time: 0.148159 Dec 09 01:12:24.997958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 313/599] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:24 2021] DELETE /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:25.007818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:25.008386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:25.009281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:25.017156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-74ef5d61-41cf-4655-b42a-88c4c0eb359f tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.233016 Dec 09 01:12:25.018144 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:25.018626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:25.019470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:25.020002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:25.027010 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 287/600] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:24 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:25.153953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:25.154770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:25.171175 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:25.172693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:25.174551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:25.175597 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:25.177399 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:25.184257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-926d5cfe-016d-4e76-a8d8-2804d6097b6e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1514 microversion: 2.1 time: 0.184978 Dec 09 01:12:25.184987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 314/601] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:24 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:25.229949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:25.230525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:25.231595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lazy-loading 'fault' on Instance uuid d49e39a7-1ec1-4033-ae68-8088625993b3 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:25.293547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5ff623eda804e5980eee894d43cdc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f142a63d748e48d08bff8bfeeb533566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:25.301942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-76687004-4551-46a3-b831-0792d0f33aa6 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 200 len: 1312 microversion: 2.1 time: 0.153881 Dec 09 01:12:25.302573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 288/602] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:25 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:26.035943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:26.036686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:26.042563 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.043009 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.043776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.044240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.195137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:26.202877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:26.203495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:26.203688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f6c93fa3-3ca8-493d-a0a5-9c70dbd779cc tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.171570 Dec 09 01:12:26.204265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 315/603] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:26 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:26.209703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.210159 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.210979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.211656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.319562 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:26.320197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] [instance: d49e39a7-1ec1-4033-ae68-8088625993b3] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:26.326157 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.326637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.327416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:26.328008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:26.342680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] HTTP exception thrown: Instance d49e39a7-1ec1-4033-ae68-8088625993b3 could not be found. Dec 09 01:12:26.343273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] Returning 404 to user: Instance d49e39a7-1ec1-4033-ae68-8088625993b3 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:26.344088 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1c9f2190-064c-409b-820f-42ffafc7fc89 tempest-ServerRescueNegativeTestJSON-446683539 tempest-ServerRescueNegativeTestJSON-446683539-project] 10.222.0.23 "GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3" status: 404 len: 111 microversion: 2.1 time: 0.028798 Dec 09 01:12:26.344633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 316/604] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:26 2021] GET /compute/v2.1/servers/d49e39a7-1ec1-4033-ae68-8088625993b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 09 01:12:26.383243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:26.391483 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-792aaf1d-7801-45c0-aa27-888b7aed3bd5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1514 microversion: 2.1 time: 0.191698 Dec 09 01:12:26.396662 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 289/605] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:26 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:27.221187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:27.221789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:27.228167 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:27.228615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:27.229393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:27.229827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:27.394542 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:27.403015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ba8ecd48-a8b8-443d-9546-bfcf8d5e73d4 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.185540 Dec 09 01:12:27.403920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 317/606] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:27 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:27.408221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:27.408975 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:27.418014 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:27.418649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:27.420456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:27.420989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:27.560806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:27.568201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d6600c1f-d3f6-4786-9900-4ca65f6bca02 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1514 microversion: 2.1 time: 0.163842 Dec 09 01:12:27.568770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 290/607] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:27 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:28.420171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:28.420856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:28.427286 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:28.427743 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:28.428518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:28.428960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:28.592879 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:28.593680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:28.600740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:28.601190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:28.603206 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:28.603818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:28.630826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:28.641006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4c32c4dc-42f1-4d4a-9d2c-f0b612f82884 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.223372 Dec 09 01:12:28.641006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 318/608] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:28 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:28.755756 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:28.763990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5fa0750f-9177-4b48-b245-be798a03c765 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1514 microversion: 2.1 time: 0.182236 Dec 09 01:12:28.764656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 291/609] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:28 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:29.459813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-39c66725-a707-4d7a-a460-f43e695a92f0 req-3622b185-7728-4aae-8db0-7237baab1e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b20e4d-c9a1-48c1-b548-a2ee5a24035e", "name": "network-vif-deleted", "tag": "510d459c-7c9d-470e-af1b-5c8eb4265ba1"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:29.460548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:29.460548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:12:29.471329 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-39c66725-a707-4d7a-a460-f43e695a92f0 req-3622b185-7728-4aae-8db0-7237baab1e91 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:29.472184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-39c66725-a707-4d7a-a460-f43e695a92f0 req-3622b185-7728-4aae-8db0-7237baab1e91 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:29.507030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-39c66725-a707-4d7a-a460-f43e695a92f0 req-3622b185-7728-4aae-8db0-7237baab1e91 service nova] Creating event network-vif-deleted:510d459c-7c9d-470e-af1b-5c8eb4265ba1 for instance 58b20e4d-c9a1-48c1-b548-a2ee5a24035e on hv-cinder-79053 Dec 09 01:12:29.513961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-39c66725-a707-4d7a-a460-f43e695a92f0 req-3622b185-7728-4aae-8db0-7237baab1e91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059303 Dec 09 01:12:29.519150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 319/610] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:29.560283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-239619965", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "networks": [{"uuid": "e483c8cb-55ef-4f74-8353-e0031b35ed31"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:29.645231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] validate_networks() for [('e483c8cb-55ef-4f74-8353-e0031b35ed31', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:12:29.663451 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:29.664251 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:29.680558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:29.681547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:29.682652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:29.683295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.030222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:30.038164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c26fc684-15df-4d23-a397-0dd8a97f90d1 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.383327 Dec 09 01:12:30.044308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 320/611] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:29 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:30.046470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:30.047138 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:30.054149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:30.054338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.055481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:30.056630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.096240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:30.096690 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.097187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'fault' on Instance uuid 58b20e4d-c9a1-48c1-b548-a2ee5a24035e {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:30.159457 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:30.168972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-163f5f2c-6bf1-4056-a2a7-dcfb7f7941b5 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 200 len: 1307 microversion: 2.1 time: 0.127342 Dec 09 01:12:30.170330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 321/612] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:30 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:30.244150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:12:30.244577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:12:30.246891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:12:30.247488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:12:30.248086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:12:30.259181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:30.259666 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.260536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:30.261013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:30.279868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Getting quotas for project a00edc9fc6a744efa5c33e63db2a7eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:12:30.283842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Getting quotas for user 7b9f193140654d6b9e2efbae04524b57 and project a00edc9fc6a744efa5c33e63db2a7eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:12:30.295033 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:12:30.297345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:12:30.342912 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-08124f22-5a64-4415-bf78-f0ce7b72fc5b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788247 Dec 09 01:12:30.343567 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 292/613] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:12:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:12:30.353973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e47131e4-187f-4fac-84bd-5f20d96f8a22 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:30.357704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e47131e4-187f-4fac-84bd-5f20d96f8a22 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:30.413659 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e47131e4-187f-4fac-84bd-5f20d96f8a22 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:30.423727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e47131e4-187f-4fac-84bd-5f20d96f8a22 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1218 microversion: 2.1 time: 0.073937 Dec 09 01:12:30.424362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 322/614] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:30 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:31.058116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:31.058767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:31.064847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.065302 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.066096 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.066569 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.187541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:31.188300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 58b20e4d-c9a1-48c1-b548-a2ee5a24035e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:31.197033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.198123 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.198999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.199640 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.214255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Instance 58b20e4d-c9a1-48c1-b548-a2ee5a24035e could not be found. Dec 09 01:12:31.214948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 404 to user: Instance 58b20e4d-c9a1-48c1-b548-a2ee5a24035e could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:31.215933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8b5460e7-7d97-42ff-a390-faec617a7ffb tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e" status: 404 len: 111 microversion: 2.1 time: 0.032476 Dec 09 01:12:31.216805 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 323/615] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:31 2021] GET /compute/v2.1/servers/58b20e4d-c9a1-48c1-b548-a2ee5a24035e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:31.224568 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:31.225383 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:31.231590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.232037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.232816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.233452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.261011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:31.343318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:31.347909 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4f939214-98dc-4629-b027-d7f8e4660909 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 204 len: 0 microversion: 2.1 time: 0.120775 Dec 09 01:12:31.348542 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 324/616] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:31 2021] DELETE /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 09 01:12:31.353132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-baba3e0d-db7f-46d9-b0bc-0d7d7a6ae5ed tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.299871 Dec 09 01:12:31.354280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 293/617] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:31 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:31.358550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:31.359477 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:31.366573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.368295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.369411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.370014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.441929 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:31.442735 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:31.448925 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.449430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.450336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:31.451139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:31.566815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:31.575058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4a7ba910-45de-40f5-927a-d94c0fbfd2ad tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1278 microversion: 2.1 time: 0.136997 Dec 09 01:12:31.575623 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 294/618] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:31 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:31.730594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:31.737885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8a20c87a-33cb-4dc8-99a0-ea63df600729 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1515 microversion: 2.1 time: 0.384250 Dec 09 01:12:31.738476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 325/619] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:31 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:32.373775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:32.374562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:32.381501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.382456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:32.384255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.384942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:32.592164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:32.592861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:32.601616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.602313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:32.603154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.603600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:32.752464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:32.768764 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0b47a677-ae58-4687-83ea-c8de7f239a3b tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1276 microversion: 2.1 time: 0.180401 Dec 09 01:12:32.774421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 326/620] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:32 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:32.775455 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:32.781069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:32.789609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:32.792160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f01afc06-5b12-44af-90c7-3b48c90d9f5c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.422342 Dec 09 01:12:32.793140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 295/621] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:32 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:32.796302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.796962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:32.797918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:32.805763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:33.231221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:33.239205 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7379312c-f1d7-4dd3-a6f4-b0c8d16215da tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1515 microversion: 2.1 time: 0.467518 Dec 09 01:12:33.239792 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 327/622] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:32 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:33.715085 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-4a6e890e-30d3-4c0e-88e9-7efc06b0dfd4 req-113452d5-ccb6-4296-a11a-9a5c9d3a6f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c3a262-97b1-463d-b2cb-fd476120796c", "name": "network-vif-deleted", "tag": "2d101058-b44e-46a7-aee8-3153c4df184a"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:33.717897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:33.717897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:33.728007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-4a6e890e-30d3-4c0e-88e9-7efc06b0dfd4 req-113452d5-ccb6-4296-a11a-9a5c9d3a6f6e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:33.728847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-4a6e890e-30d3-4c0e-88e9-7efc06b0dfd4 req-113452d5-ccb6-4296-a11a-9a5c9d3a6f6e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:33.741456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-4a6e890e-30d3-4c0e-88e9-7efc06b0dfd4 req-113452d5-ccb6-4296-a11a-9a5c9d3a6f6e service nova] Creating event network-vif-deleted:2d101058-b44e-46a7-aee8-3153c4df184a for instance e3c3a262-97b1-463d-b2cb-fd476120796c on hv-cinder-79053 Dec 09 01:12:33.748509 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-4a6e890e-30d3-4c0e-88e9-7efc06b0dfd4 req-113452d5-ccb6-4296-a11a-9a5c9d3a6f6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037321 Dec 09 01:12:33.749420 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 296/623] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:33.787562 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:33.789411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:33.796954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:33.797639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:33.799016 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:33.799598 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:33.816689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:33.817492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:33.831394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:33.831951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:33.834556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:33.835090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:34.313992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:34.338045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f89bd069-0a62-428e-81b1-512d0dfe34eb tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.553993 Dec 09 01:12:34.348184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 328/624] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:33 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:34.355392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:34.356525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:34.364588 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:34.365384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:34.367833 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:34.368574 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:34.377733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:34.389393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-43b0c188-e598-488f-bce6-e928d41cd37e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.582891 Dec 09 01:12:34.390339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 297/625] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:33 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:34.420318 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:34.420761 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:34.421218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lazy-loading 'fault' on Instance uuid e3c3a262-97b1-463d-b2cb-fd476120796c {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:34.484945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:34.497313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-552276a2-8c4b-4356-a828-3be100f0e3b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 200 len: 1308 microversion: 2.1 time: 0.155806 Dec 09 01:12:34.498135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 329/626] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:34 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:35.007560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-feb328df-f5c8-42e7-a8fa-81fb3f2362f0 req-06ec814a-2b0f-488a-8ebe-1095f452ab2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d80839-08e4-4e21-877d-e51fad18ac70", "tag": "0c501887-3f39-4b35-a841-8e12b1ee0529"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:35.010054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:35.010054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:35.019957 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-feb328df-f5c8-42e7-a8fa-81fb3f2362f0 req-06ec814a-2b0f-488a-8ebe-1095f452ab2a service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.020869 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-feb328df-f5c8-42e7-a8fa-81fb3f2362f0 req-06ec814a-2b0f-488a-8ebe-1095f452ab2a service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.033246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-feb328df-f5c8-42e7-a8fa-81fb3f2362f0 req-06ec814a-2b0f-488a-8ebe-1095f452ab2a service nova] Creating event network-changed:0c501887-3f39-4b35-a841-8e12b1ee0529 for instance 24d80839-08e4-4e21-877d-e51fad18ac70 on hv-cinder-79053 Dec 09 01:12:35.038859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-feb328df-f5c8-42e7-a8fa-81fb3f2362f0 req-06ec814a-2b0f-488a-8ebe-1095f452ab2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035202 Dec 09 01:12:35.039642 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 298/627] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:35.356374 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:35.356995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:35.364326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.364795 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.365600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.366043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.409616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:35.410496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:35.417325 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.417841 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.418644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.419080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.746079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:35.755719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3795527b-a3a9-48a9-974f-bc295e4f1a75 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.402788 Dec 09 01:12:35.756960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 330/628] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:35 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:35.763626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:35.764684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: e3c3a262-97b1-463d-b2cb-fd476120796c] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:35.776718 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.779926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.781036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:35.781481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:35.781896 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:35.796668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c7c14305-4993-4949-ae2b-d8f6f0647663 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.389389 Dec 09 01:12:35.797277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 299/629] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:35 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:35.799160 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Instance e3c3a262-97b1-463d-b2cb-fd476120796c could not be found. Dec 09 01:12:35.800192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 404 to user: Instance e3c3a262-97b1-463d-b2cb-fd476120796c could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:35.801279 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-95acc9ce-7ad6-4a29-986c-1eb8b1c5e0b4 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c" status: 404 len: 111 microversion: 2.1 time: 0.042660 Dec 09 01:12:35.801826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 331/630] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:35 2021] GET /compute/v2.1/servers/e3c3a262-97b1-463d-b2cb-fd476120796c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:36.775760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:36.776385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:36.792196 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:36.792880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:36.793795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:36.794499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:36.815903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:36.817843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:36.825740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:36.826544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:36.828011 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:36.828638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:37.022115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:37.029791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dec6cc01-6493-4f82-be8c-9c0ed298f01f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.259834 Dec 09 01:12:37.030312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 300/631] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:36 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:37.041335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:37.042057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:37.049157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:37.049989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:37.053660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:37.054954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:37.055868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:37.067541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-748c66c6-0efa-48f0-8f32-5e4954b0d44e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.255580 Dec 09 01:12:37.079973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 332/632] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:36 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:37.087089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Going to try to terminate instance {{(pid=116067) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:12:37.194333 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e7c1b419-2ebc-498e-b050-c69dc76ee37f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 204 len: 0 microversion: 2.1 time: 0.161958 Dec 09 01:12:37.194960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 301/633] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:12:37 2021] DELETE /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:12:37.203216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:37.203991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:37.210218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:37.211081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:37.212394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:37.213208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:37.388846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:37.396786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a9c1e5b1-0476-468a-b662-7c4f8fab4138 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1513 microversion: 2.1 time: 0.197100 Dec 09 01:12:37.398838 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 333/634] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:37 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:38.041504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: .version_select at 0x7fe619eab9d0>, body: {"keypair": {"name": "tempest-keypair-532470873"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:38.048253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:38.048975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:38.056644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.057301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.058392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.058971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.061345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:12:38.074318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:12:38.207635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:38.215560 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-61e433ef-cde8-430e-a695-18457e435919 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.171534 Dec 09 01:12:38.216117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 334/635] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:38 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:38.220714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:38.221464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:38.228139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.228590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.229367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.229805 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.281633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:12:38.285313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:12:38.302020 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-59283aae-a021-4fd9-bb6b-f834c4684aba tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.413448 Dec 09 01:12:38.303017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 302/636] 10.222.0.23 () {62 vars in 1198 bytes} [Thu Dec 9 01:12:37 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 415 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 09 01:12:38.407639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:38.419040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e8a73705-41eb-4ac1-95ca-2b98c0ff949c tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.201430 Dec 09 01:12:38.419477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:38.419623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 335/637] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:38 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:38.420815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:38.427017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.427610 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.428523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:38.429022 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:38.658773 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:38.671384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-78ee2644-444f-45c9-ba36-652eed9f527e tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1513 microversion: 2.1 time: 0.258793 Dec 09 01:12:38.673128 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 303/638] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:38 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:39.235267 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:39.235879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:39.243386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.244229 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:39.245191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.245775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:39.439298 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:39.440792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:39.453549 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.454265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:39.455266 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.455720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:39.591646 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:39.608164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-eb968a06-84dd-4357-bfe2-918c54590f7d tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.378066 Dec 09 01:12:39.609565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 336/639] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:39 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:39.689846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:39.690713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:39.696830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.697367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:39.698418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:39.699087 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:40.161581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:40.179661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-42a5b32a-b7c9-4cd3-b0c2-147b9e53ab16 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1755 microversion: 2.1 time: 0.744783 Dec 09 01:12:40.195227 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 304/640] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:39 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1755 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:40.328029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2b98f1809405ab307a035062400c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f062a4353046c9a44957550c394c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:40.340767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e9301dcb-ae24-49e3-92f4-670d9f185da2 tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 200 len: 1513 microversion: 2.1 time: 0.653671 Dec 09 01:12:40.349950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 337/641] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:39 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 1513 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:40.642680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:40.648903 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:40.673280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1934685705", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccbffc9b-fb85-4600-abf1-45c776b606b2"}], "security_groups": [{"name": "tempest-securitygroup--1802320778"}], "key_name": "tempest-keypair-532470873", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:40.707355 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:40.707355 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:40.713703 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:40.714470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:40.911181 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] validate_networks() for [('ccbffc9b-fb85-4600-abf1-45c776b606b2', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:12:41.048525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:41.059366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7700aaf7-3379-4266-9263-80e60a1375e9 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.431053 Dec 09 01:12:41.060349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 305/642] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:40 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:41.065505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-75c96e9e-2698-4fcd-9b2d-2c8bdf36d133 req-6500672c-0264-4d5a-a25e-f173784f12c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d80839-08e4-4e21-877d-e51fad18ac70", "name": "network-vif-plugged", "status": "completed", "tag": "0c501887-3f39-4b35-a841-8e12b1ee0529"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:41.067673 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:41.067673 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:41.078225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-75c96e9e-2698-4fcd-9b2d-2c8bdf36d133 req-6500672c-0264-4d5a-a25e-f173784f12c7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.078798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-75c96e9e-2698-4fcd-9b2d-2c8bdf36d133 req-6500672c-0264-4d5a-a25e-f173784f12c7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.092826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-75c96e9e-2698-4fcd-9b2d-2c8bdf36d133 req-6500672c-0264-4d5a-a25e-f173784f12c7 service nova] Creating event network-vif-plugged:0c501887-3f39-4b35-a841-8e12b1ee0529 for instance 24d80839-08e4-4e21-877d-e51fad18ac70 on hv-cinder-79053 Dec 09 01:12:41.103101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-75c96e9e-2698-4fcd-9b2d-2c8bdf36d133 req-6500672c-0264-4d5a-a25e-f173784f12c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041163 Dec 09 01:12:41.103891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 306/643] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:41.109015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-28aad344-79b7-4488-aeb8-ba735b5cd1a0 req-1d0dfcf1-0034-49d7-8418-b3a7807eea74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b888f-f816-49a9-ad1b-5aec93ff2873", "name": "network-vif-deleted", "tag": "45951bb1-90b0-42b8-aa49-f5040ab0860b"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:41.110741 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:41.110741 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:41.118994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-28aad344-79b7-4488-aeb8-ba735b5cd1a0 req-1d0dfcf1-0034-49d7-8418-b3a7807eea74 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.119478 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-28aad344-79b7-4488-aeb8-ba735b5cd1a0 req-1d0dfcf1-0034-49d7-8418-b3a7807eea74 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.133976 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-28aad344-79b7-4488-aeb8-ba735b5cd1a0 req-1d0dfcf1-0034-49d7-8418-b3a7807eea74 service nova] Creating event network-vif-deleted:45951bb1-90b0-42b8-aa49-f5040ab0860b for instance 3d2b888f-f816-49a9-ad1b-5aec93ff2873 on hv-cinder-79053 Dec 09 01:12:41.138960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-28aad344-79b7-4488-aeb8-ba735b5cd1a0 req-1d0dfcf1-0034-49d7-8418-b3a7807eea74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Dec 09 01:12:41.139860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 307/644] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:41.199557 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:41.200679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:41.212557 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.213310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.214794 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.215248 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.551466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:12:41.551466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:12:41.551466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:12:41.552200 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:12:41.552200 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:12:41.563979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.565334 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.566173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.566641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.572870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:41.582620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-78095036-035d-46a0-9586-9c2ce7ccb7c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1758 microversion: 2.1 time: 0.389146 Dec 09 01:12:41.590425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 308/645] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:41 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1758 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:41.590894 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:12:41.590988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:41.590988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] [instance: 3d2b888f-f816-49a9-ad1b-5aec93ff2873] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:41.594200 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:12:41.595963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.596720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.597204 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:41.597674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:41.607022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:12:41.609362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:12:41.612576 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] HTTP exception thrown: Instance 3d2b888f-f816-49a9-ad1b-5aec93ff2873 could not be found. Dec 09 01:12:41.613179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] Returning 404 to user: Instance 3d2b888f-f816-49a9-ad1b-5aec93ff2873 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:12:41.614009 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4f57ef1c-e87a-46ba-b713-b4beaeda760f tempest-AttachVolumeNegativeTest-1185790388 tempest-AttachVolumeNegativeTest-1185790388-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873" status: 404 len: 111 microversion: 2.1 time: 0.029220 Dec 09 01:12:41.614793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 309/646] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:41 2021] GET /compute/v2.1/servers/3d2b888f-f816-49a9-ad1b-5aec93ff2873 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:12:41.669939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d963ce0d-b7dd-4729-b18f-544e49a8fe29 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.001786 Dec 09 01:12:41.670621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 338/647] 10.222.0.23 () {62 vars in 1187 bytes} [Thu Dec 9 01:12:40 2021] POST /compute/v2.1/servers => generated 402 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 09 01:12:41.680674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:41.681285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:41.782265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:41.792110 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:41.793926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:41.795107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0955a787-41f9-442a-bc8e-d8ac880a170b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1281 microversion: 2.20 time: 0.118203 Dec 09 01:12:41.802771 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 310/648] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:41 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:42.082965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:42.083802 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:42.091979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:42.092508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:42.093299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:42.093981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:42.256084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:42.265614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e1b2470d-d6de-4984-b4be-9fc4aa0deb3a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1318 microversion: 2.1 time: 0.187626 Dec 09 01:12:42.274908 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 339/649] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:42 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:42.812839 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:42.813508 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:42.821127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:42.821738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:42.822772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:42.823222 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:42.899045 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:42.907403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:42.908876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:42.909958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4531908e-3a38-476b-a592-85a893fd4dfe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1333 microversion: 2.20 time: 0.100816 Dec 09 01:12:42.910519 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 311/650] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:42 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:43.283494 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:43.284899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:43.292479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.293315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:43.294801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.295730 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:43.539234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:43.547899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0cf573ab-63bf-473e-9a40-643928be8a3c tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1506 microversion: 2.1 time: 0.268844 Dec 09 01:12:43.549059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 340/651] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:43 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:43.565306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef715ce9-b104-42ef-975d-6fd7ef416e4a", "device": "/dev/sdb"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:43.566974 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:43.574687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.575349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:43.576944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.577516 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:43.890751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f2f1bc8b-cdaf-402d-80f9-0e9862b4b33a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "POST /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329063 Dec 09 01:12:43.902570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 312/652] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:12:43 2021] POST /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:43.929137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:43.930163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:43.940338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.940984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:43.942645 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:43.943275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:44.246964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:44.259205 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:44.261952 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:44.263337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-eded706a-4aab-4bd3-9351-187f7a7a4220 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.338715 Dec 09 01:12:44.264429 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 341/653] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:43 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:44.872501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-3a757254-d6df-43ac-89cd-3ba56f0e0cba req-b6bbc50b-297f-4848-8e19-e87af8b4dddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:44.873975 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:44.873975 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:12:44.882164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-3a757254-d6df-43ac-89cd-3ba56f0e0cba req-b6bbc50b-297f-4848-8e19-e87af8b4dddc service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:44.883551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-3a757254-d6df-43ac-89cd-3ba56f0e0cba req-b6bbc50b-297f-4848-8e19-e87af8b4dddc service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:44.896347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-3a757254-d6df-43ac-89cd-3ba56f0e0cba req-b6bbc50b-297f-4848-8e19-e87af8b4dddc service nova] Creating event network-changed:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:12:44.901924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-3a757254-d6df-43ac-89cd-3ba56f0e0cba req-b6bbc50b-297f-4848-8e19-e87af8b4dddc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033345 Dec 09 01:12:44.903155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 313/654] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:12:45.282409 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:45.283272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:45.290596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:45.291137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:45.292032 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:45.292474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:45.431373 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:45.439421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:45.440905 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:45.442006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-74313c9c-d491-41e1-b893-ac2fb96a345f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.163288 Dec 09 01:12:45.442827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 342/655] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:45 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:12:46.460277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:46.461677 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:46.468002 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:46.468446 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:46.469206 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:46.469638 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:46.605063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:46.612759 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:46.614232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:46.615344 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-81308eed-3276-4772-a6e2-b9d30abbdb5b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.159505 Dec 09 01:12:46.615897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 314/656] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:46 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:12:46.832104 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:46.832652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:46.838894 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:46.839342 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:46.840121 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:46.840555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:46.920610 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lazy-loading 'services' on Instance uuid b11e7d82-d6f0-4625-980e-40d38e06de06 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:12:46.990843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e1c9a726-da05-4016-9242-d2cc7cbafe83 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments/9ff055ac-3333-409b-8afa-e2accd2c79a7" status: 202 len: 0 microversion: 2.1 time: 0.161795 Dec 09 01:12:46.991438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 343/657] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:12:46 2021] DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments/9ff055ac-3333-409b-8afa-e2accd2c79a7 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:12:47.632828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:47.633436 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:47.639682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:47.640075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:47.640851 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:47.641296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:47.773676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:47.781229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:47.782736 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:47.783823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0e5353c0-2a88-4778-9900-7d45febc265c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.154794 Dec 09 01:12:47.784379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 315/658] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:47 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:48.803089 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:48.803725 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:48.809746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:48.810191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:48.810989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:48.811420 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:48.945264 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:48.952945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:48.954456 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:48.955554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0f3fc3dd-6cb0-4abb-a95f-4c071f0d0049 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.157230 Dec 09 01:12:48.956117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 344/659] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:48 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:49.973974 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:49.974655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:49.981523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:49.981970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:49.982855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:49.983318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:50.113733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:50.121513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:50.123026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:50.124106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7824e441-9fe6-457a-857e-c1406c336486 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.153860 Dec 09 01:12:50.124655 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 316/660] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:49 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:51.142329 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:51.142960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:51.149835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:51.150283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:51.151077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:51.151509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:51.283748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:51.291992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:51.293489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:51.294616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-97a1a6e9-98e0-4b8d-9dc9-e8d13bdc0567 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.156117 Dec 09 01:12:51.295177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 345/661] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:51 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:52.311665 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:52.312267 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:52.318792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:52.319242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:52.320023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:52.320465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:52.462036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:52.470688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:52.473960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:52.475330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f6fdaa45-cbdc-467e-ace4-00d2f6050d4d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.167105 Dec 09 01:12:52.475950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 317/662] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:52 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:53.494471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:53.495727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:53.502077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:53.502632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:53.503417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:53.503853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:53.641865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:53.650206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:53.651729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:53.652841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3a1cd06c-8235-47e7-9108-68c4253823c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.162765 Dec 09 01:12:53.653409 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 346/663] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:53 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:54.422097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-33a9fe9e-0767-499a-8485-2c17850c078f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:54.428529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33a9fe9e-0767-499a-8485-2c17850c078f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:54.429056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-33a9fe9e-0767-499a-8485-2c17850c078f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:54.451295 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-33a9fe9e-0767-499a-8485-2c17850c078f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Going to try to stop instance {{(pid=116067) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 09 01:12:54.495422 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-33a9fe9e-0767-499a-8485-2c17850c078f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 202 len: 0 microversion: 2.1 time: 0.076668 Dec 09 01:12:54.496044 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 318/664] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:12:54 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:12:54.503844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:54.504584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:54.512018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:54.512774 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:54.513971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:54.514523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:54.648958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:54.657326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-bfb79383-da6c-4a6d-b929-223c57c46695 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.157047 Dec 09 01:12:54.657889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 347/665] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:54 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:12:54.670822 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:54.671529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:54.677535 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:54.677985 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:54.678807 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:54.679253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:54.809365 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:54.817311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:54.818831 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:54.819926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e2ae0af7-94f0-4e35-8006-441efef50657 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.153090 Dec 09 01:12:54.820481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 319/666] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:54 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:55.674081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:55.674668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:55.681137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:55.681587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:55.682393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:55.682822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:55.815711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:55.823836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-60ff6e91-a810-47c8-a525-489787077112 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.153514 Dec 09 01:12:55.824401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 348/667] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:55 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:55.839221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:55.840288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:55.848582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:55.849032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:55.849845 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:55.850274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:55.979067 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:55.986649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:55.988132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:55.989221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-849a0786-b4d9-45f3-9494-a6ecb30f996c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.154663 Dec 09 01:12:55.989776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 320/668] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:55 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:56.234175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-42c9c46e-194e-45c0-aaea-35f775c801d6 req-aeff7481-ecb6-4c3a-ab60-0cc9dd2f18d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "name": "network-vif-plugged", "status": "completed", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:12:56.235972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:12:56.235972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:12:56.243790 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-42c9c46e-194e-45c0-aaea-35f775c801d6 req-aeff7481-ecb6-4c3a-ab60-0cc9dd2f18d9 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:56.244221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-42c9c46e-194e-45c0-aaea-35f775c801d6 req-aeff7481-ecb6-4c3a-ab60-0cc9dd2f18d9 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:56.255229 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-42c9c46e-194e-45c0-aaea-35f775c801d6 req-aeff7481-ecb6-4c3a-ab60-0cc9dd2f18d9 service nova] Creating event network-vif-plugged:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:12:56.260241 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-42c9c46e-194e-45c0-aaea-35f775c801d6 req-aeff7481-ecb6-4c3a-ab60-0cc9dd2f18d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030274 Dec 09 01:12:56.260830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 349/669] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:12:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:12:56.840984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:56.841614 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:56.848135 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:56.848585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:56.849424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:56.849808 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:56.979544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:56.986797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-37f07262-e76a-48fb-82f8-044ad70e6f39 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.149813 Dec 09 01:12:56.987358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 321/670] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:56 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:57.008392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:57.009325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:57.015611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:57.016067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:57.016857 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:57.017296 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:57.162774 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:57.172887 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:57.174405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:57.175509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a5d50874-8306-450b-b5f5-8ac802b2e3d8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.171105 Dec 09 01:12:57.176101 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 350/671] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:57 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:58.004262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:58.004877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:58.011876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:58.012334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:58.013113 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:58.013557 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:58.146722 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:58.154294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3a3b21d0-a3e2-4a87-963f-58d5ee30285e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.153708 Dec 09 01:12:58.154884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 322/672] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:57 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:58.193728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:58.194332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:58.201158 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:58.201599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:58.202385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:58.202814 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:58.335027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:58.343758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:58.345233 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:58.346317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c8e0487f-aff2-4c88-9244-672ebf3a2dc5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.156198 Dec 09 01:12:58.346914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 351/673] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:58 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:12:59.171548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:59.172175 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:59.178651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:59.179319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:59.180230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:59.181680 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:59.324478 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:59.333507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3c24f2ec-50de-4372-a4e0-bc698d6c4474 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.165698 Dec 09 01:12:59.334077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 323/674] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:12:59 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:12:59.365303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:12:59.365916 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:12:59.373272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:59.373724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:59.374718 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:12:59.375162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:12:59.518112 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:59.527845 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:59.529664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:12:59.531041 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-078ece15-ac90-46b4-a8eb-074736bf60d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.170129 Dec 09 01:12:59.531603 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 352/675] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:12:59 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:13:00.351029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:00.351717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:00.358759 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:00.359278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:00.360055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:00.360492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:00.497325 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:00.504709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bfd4ffcb-0450-4f68-9944-643d7e53da75 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.157290 Dec 09 01:13:00.505264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 324/676] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:00 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:00.549098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:00.550446 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:00.558131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:00.558872 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:00.559724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:00.560290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:00.696179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:00.704045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:00.705550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:00.706679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-17fcf4f2-ff71-4bb9-b112-c94b172d7d75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1407 microversion: 2.20 time: 0.161507 Dec 09 01:13:00.707230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 353/677] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:13:00 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:13:01.526883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:01.528034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:01.538579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.539364 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.540769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.541545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.685990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:01.693573 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e0c265d1-6a20-4d87-8b44-eeef054843f4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.174434 Dec 09 01:13:01.694132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 325/678] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:01 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:01.725269 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:01.725874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:01.732246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.732691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.733457 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.733890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.864440 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:01.873480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:01.875061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:01.876228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a91b5a48-ea46-45df-9c1b-b0c0b580876d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1599 microversion: 2.20 time: 0.154665 Dec 09 01:13:01.876841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 354/679] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:13:01 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:13:01.895273 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:01.895740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:01.901670 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.902131 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.902970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:01.903404 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:01.984839 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0111e852-e1c1-4560-a971-02048ea6d265 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093278 Dec 09 01:13:01.985424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 326/680] 10.222.0.23 () {60 vars in 1315 bytes} [Thu Dec 9 01:13:01 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:13:02.715830 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:02.716565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:02.731598 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:02.732947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:02.746045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:02.746712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:02.894531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:02.903392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4e912a2b-2047-4492-a15c-9a4f441a0ec2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.194662 Dec 09 01:13:02.904043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 355/681] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:02 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:03.170777 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:03.171590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-3e05a09a-6895-41ba-9a0a-e1fb352952b6 req-8efcf600-dde8-4f00-a7ae-b89f523f4e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:03.173876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:03.174945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:13:03.174945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:13:03.182140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-3e05a09a-6895-41ba-9a0a-e1fb352952b6 req-8efcf600-dde8-4f00-a7ae-b89f523f4e82 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:03.182533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:03.182651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-3e05a09a-6895-41ba-9a0a-e1fb352952b6 req-8efcf600-dde8-4f00-a7ae-b89f523f4e82 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:03.183299 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:03.184549 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:03.185442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:03.195119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-3e05a09a-6895-41ba-9a0a-e1fb352952b6 req-8efcf600-dde8-4f00-a7ae-b89f523f4e82 service nova] Creating event network-changed:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:13:03.201400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-3e05a09a-6895-41ba-9a0a-e1fb352952b6 req-8efcf600-dde8-4f00-a7ae-b89f523f4e82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039574 Dec 09 01:13:03.203230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 356/682] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:13:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:03.309413 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4ffb29c1-f34d-488c-b55c-9b7fee40cc0c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.149607 Dec 09 01:13:03.312891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 327/683] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:03 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:03.921484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:03.922317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:03.931635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:03.932075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:03.933076 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:03.933644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:04.095987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:04.106871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2597c0af-34f9-4811-9484-8aa4f6aebd1f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.190383 Dec 09 01:13:04.107548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 357/684] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:03 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:04.321945 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:04.323296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:04.330046 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:04.330830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:04.331623 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:04.332062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:04.435296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b47dbe81-75cf-4dc6-a09a-c4384d4e11f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.118423 Dec 09 01:13:04.436017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 328/685] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:04 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:05.123840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:05.124653 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:05.131599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.132054 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.132852 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.133290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.273547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:05.281385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-05173bbd-f2aa-4852-97ec-c19eb68d3f3e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.161337 Dec 09 01:13:05.281966 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 358/686] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:05 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:05.318962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:05.319538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:05.326425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.327023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.327641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.328073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.406951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lazy-loading 'services' on Instance uuid 24d80839-08e4-4e21-877d-e51fad18ac70 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:13:05.447415 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:05.448860 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:05.459302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.459989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.461033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:05.461888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:05.485824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4e2f08b8-54b9-4c1e-914b-b3dc3c354a7f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70/os-volume_attachments/ef715ce9-b104-42ef-975d-6fd7ef416e4a" status: 202 len: 0 microversion: 2.1 time: 0.170693 Dec 09 01:13:05.486512 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 329/687] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:13:05 2021] DELETE /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70/os-volume_attachments/ef715ce9-b104-42ef-975d-6fd7ef416e4a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:05.587713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-75cf7f66-2ef4-4931-be0d-10877304c39f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.145093 Dec 09 01:13:05.589024 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 359/688] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:05 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:06.299477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:06.300058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:06.306818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.309006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.310002 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.310840 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.455119 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:06.462744 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f2cf6093-5888-418d-9766-b52372e2a88e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.167766 Dec 09 01:13:06.464227 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 330/689] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:06 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:06.604028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:06.612408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:06.613085 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:06.615878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:06.629865 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.632354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.633493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.633938 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.637822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.639249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.640220 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.642689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.677384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Going to try to terminate instance {{(pid=116067) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:13:06.747560 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fe7a5b4d-3c05-444b-8c55-befa1648083c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.150629 Dec 09 01:13:06.752437 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 360/690] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:06 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:06.762770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-25727366-2b4d-493a-9b89-be74873eaf49 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 204 len: 0 microversion: 2.1 time: 0.154150 Dec 09 01:13:06.764098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 331/691] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:13:06 2021] DELETE /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:13:06.782924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:06.783567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:06.790792 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.791381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.792262 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:06.792949 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:06.944427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:06.952971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0291497d-0a47-44d9-9a8b-72f09d21a9c0 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.184599 Dec 09 01:13:06.957487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 361/692] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:06 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:07.482028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:07.482678 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:07.488790 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.489240 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:07.490049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.490515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:07.631263 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:07.638658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bcbf99a5-ff55-4783-87cf-c7ed1df855de tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.161508 Dec 09 01:13:07.639225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 332/693] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:07 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:07.757737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:07.758689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:07.765020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.765467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:07.766244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.766712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:07.880821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c9099418-335c-49c7-8710-d16f8c1adfe0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.126692 Dec 09 01:13:07.881557 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 362/694] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:07 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:07.974811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:07.975425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:07.982460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.982946 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:07.983681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:07.984123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:08.115434 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:08.123431 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-61e5f9aa-25ce-4fef-b061-c074a44fc127 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.152358 Dec 09 01:13:08.123994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 333/695] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:07 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:08.656595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:08.657320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:08.664226 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:08.664671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:08.665447 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:08.665881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:08.800816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:08.808280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-dee3064d-1f02-482c-b4bb-52cfa7936ce1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.155656 Dec 09 01:13:08.808881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 363/696] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:08 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:08.892899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:08.893859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:08.900106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:08.900554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:08.901389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:08.902359 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:09.140865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:09.141414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:09.147875 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:09.148359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:09.149142 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:09.149582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:09.280868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:09.288140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1109a840-de4d-496d-b660-2a6814287c4e tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.151049 Dec 09 01:13:09.288706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 364/697] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:09 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:09.825961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:09.826618 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:09.832847 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:09.833297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:09.834067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:09.834543 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:09.966289 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:09.973466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-beacdc3c-7d58-4299-9c24-36857c09d237 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.152237 Dec 09 01:13:09.974039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 365/698] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:09 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:10.305450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:10.306060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:10.312299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:10.312744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:10.313517 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:10.313952 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:10.442018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:10.449880 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4310da34-a466-4177-bd86-b900c2baee4f tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.148079 Dec 09 01:13:10.450458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 366/699] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:10 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:10.990683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:10.991326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:10.997503 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:10.997947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:10.998753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:10.999187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:11.126518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:11.133693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4e28a7ee-31e5-4949-8d6c-3f3d18546967 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.146728 Dec 09 01:13:11.134246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 367/700] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:10 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:11.468152 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:11.468769 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:11.474985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:11.475433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:11.476268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:11.476706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:11.611889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:11.621543 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6ab54a9f-0234-4565-b0c5-10eba4938cde tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.158406 Dec 09 01:13:11.622630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 368/701] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:11 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:11.638715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-954da573-6f62-4ff7-b077-458f36302abf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 2.749447 Dec 09 01:13:11.640090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 334/702] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:08 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 2751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:12.150462 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:12.150997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:12.158532 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.158984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.159759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.160197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.293619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:12.300844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3af35647-ae09-4ae3-9394-992600b49126 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.154155 Dec 09 01:13:12.301402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 369/703] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:12 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:12.639215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:12.640021 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:12.647096 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.647556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.648344 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.648788 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.650318 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:12.651280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:12.659701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.660493 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.661621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:12.662788 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:12.787594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:12.795174 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0f7ff252-781e-4a53-a11e-0311747cbaa1 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.159955 Dec 09 01:13:12.795724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 335/704] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:12 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:13.318104 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:13.318769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:13.325926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:13.326387 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:13.327160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:13.327595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:13.456395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:13.463575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-61d5982b-cd44-45ed-90fa-ae631689a221 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.149104 Dec 09 01:13:13.464144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 336/705] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:13 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:13.811888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:13.812508 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:13.818944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:13.819436 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:13.820278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:13.820727 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:13.950554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:13.958131 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-13c1a7cf-1f56-42e7-bdc7-52cdb3612c14 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.149915 Dec 09 01:13:13.958733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 337/706] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:13 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:14.480514 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:14.481140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:14.487349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:14.487797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:14.488558 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:14.488999 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:14.620470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:14.630564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4fc17b2f-914a-4425-8421-0b589fa62f5d tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1677 microversion: 2.1 time: 0.153674 Dec 09 01:13:14.631143 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 338/707] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:14 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:14.939285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1317f5c3-be2c-43f3-98a5-1511c70002af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 2.293925 Dec 09 01:13:14.939951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 370/708] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:12 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:14.975994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:14.976534 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:14.983336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:14.983785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:14.984555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:14.984991 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.114449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:15.122508 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e4fce76f-3238-4494-b6a5-b388717ac03a tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1512 microversion: 2.1 time: 0.150126 Dec 09 01:13:15.123137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 339/709] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:14 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:15.618954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-a0a3dfaa-4e50-4f1f-a19b-501abeb221d9 req-50e09404-c023-4965-8abc-a6140cdda0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d80839-08e4-4e21-877d-e51fad18ac70", "name": "network-vif-deleted", "tag": "0c501887-3f39-4b35-a841-8e12b1ee0529"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:15.620638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:13:15.620638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:13:15.629080 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a0a3dfaa-4e50-4f1f-a19b-501abeb221d9 req-50e09404-c023-4965-8abc-a6140cdda0cb service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.629529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a0a3dfaa-4e50-4f1f-a19b-501abeb221d9 req-50e09404-c023-4965-8abc-a6140cdda0cb service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.641263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a0a3dfaa-4e50-4f1f-a19b-501abeb221d9 req-50e09404-c023-4965-8abc-a6140cdda0cb service nova] Creating event network-vif-deleted:0c501887-3f39-4b35-a841-8e12b1ee0529 for instance 24d80839-08e4-4e21-877d-e51fad18ac70 on hv-cinder-79053 Dec 09 01:13:15.645977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-a0a3dfaa-4e50-4f1f-a19b-501abeb221d9 req-50e09404-c023-4965-8abc-a6140cdda0cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Dec 09 01:13:15.646616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 371/710] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:13:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:15.648301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:15.648974 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:15.655860 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.656303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.657089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.657555 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.811074 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:15.818485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a176057e-6a90-455b-ae82-a501b2e4fecd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1654 microversion: 2.1 time: 0.174132 Dec 09 01:13:15.819377 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 340/711] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:15 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1654 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:15.837118 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-aa89b9dc-751f-439d-91bc-bd84f20ce16f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:15.844900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aa89b9dc-751f-439d-91bc-bd84f20ce16f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.845339 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-aa89b9dc-751f-439d-91bc-bd84f20ce16f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.916552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-aa89b9dc-751f-439d-91bc-bd84f20ce16f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Going to try to start instance {{(pid=116068) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 09 01:13:15.951683 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:15.952799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:15.960103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.960717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.961664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.962249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.968597 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-aa89b9dc-751f-439d-91bc-bd84f20ce16f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action" status: 202 len: 0 microversion: 2.1 time: 0.136337 Dec 09 01:13:15.969268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 372/712] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:13:15 2021] POST /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:15.978536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:15.979552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:15.987882 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.988706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:15.989738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:15.990396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:16.093796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b5724eb0-0a91-4c9f-a946-2bb06d4e73de tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 14 microversion: 2.20 time: 0.146945 Dec 09 01:13:16.094823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 341/713] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:15 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:16.141667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:16.142407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:16.152462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:16.153170 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:16.154157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:16.154629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:16.172589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:16.181618 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ec36397a-0320-4b68-92b0-6cc34abf6fd2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1663 microversion: 2.1 time: 0.207820 Dec 09 01:13:16.182655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 373/714] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:15 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:16.208950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:16.209546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:16.210012 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lazy-loading 'fault' on Instance uuid 24d80839-08e4-4e21-877d-e51fad18ac70 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:13:16.270158 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b9f193140654d6b9e2efbae04524b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00edc9fc6a744efa5c33e63db2a7eb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:16.282609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5df4313e-0524-442c-818c-73f9748cb754 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 200 len: 1308 microversion: 2.1 time: 0.145317 Dec 09 01:13:16.283500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 342/715] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:16 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:17.105418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:17.106511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:17.113074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.113524 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.114308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.114767 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.199004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:17.199618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:17.205857 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.206312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.207120 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.207565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.387955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:17.396424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d24c67ff-15b6-47d8-a49e-002b83b642d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1663 microversion: 2.1 time: 0.201513 Dec 09 01:13:17.397052 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 343/716] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:17 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:17.410231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:17.410891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] [instance: 24d80839-08e4-4e21-877d-e51fad18ac70] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:17.417411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.417861 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.418677 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:17.419115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:17.432153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] HTTP exception thrown: Instance 24d80839-08e4-4e21-877d-e51fad18ac70 could not be found. Dec 09 01:13:17.433348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] Returning 404 to user: Instance 24d80839-08e4-4e21-877d-e51fad18ac70 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:13:17.434173 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3bb5ec5f-a35e-4be3-b4a7-2d5ece114e81 tempest-VolumesSnapshotTestJSON-884373893 tempest-VolumesSnapshotTestJSON-884373893-project] 10.222.0.23 "GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70" status: 404 len: 111 microversion: 2.1 time: 0.036224 Dec 09 01:13:17.434744 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 344/717] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:17 2021] GET /compute/v2.1/servers/24d80839-08e4-4e21-877d-e51fad18ac70 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:13:18.413949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:18.414604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:18.422274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:18.422763 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:18.423543 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:18.423980 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:18.766632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:18.773724 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ae8d9910-d243-49a5-b62c-156bbee0b33e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1663 microversion: 2.1 time: 0.363374 Dec 09 01:13:18.774272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 345/718] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:18 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1663 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:13:19.547717 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-602887c8-dffe-4d80-9387-41feccd07783 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 17904 microversion: 2.20 time: 2.446390 Dec 09 01:13:19.548377 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 374/719] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:17 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 17904 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:19.790976 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:19.791675 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:19.800524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:19.800524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:19.800524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:19.800905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:19.944155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:19.951622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0caefbc5-5b36-471c-bd93-a54dc13810b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1663 microversion: 2.1 time: 0.164246 Dec 09 01:13:19.952173 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 346/720] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:19 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:20.564968 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:20.564968 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:20.567851 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:20.568297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:20.569068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:20.569496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:20.677483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e5c70419-702c-4178-a083-abdc4eddafad tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 18827 microversion: 2.20 time: 0.121833 Dec 09 01:13:20.678131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 375/721] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:20 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 18827 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:20.970599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:20.970599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:20.975743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:20.976204 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:20.976984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:20.977418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:21.110350 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:21.120925 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1c86d957-d3e3-4b2c-8dc6-2a9704ba4d4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1667 microversion: 2.1 time: 0.155695 Dec 09 01:13:21.121502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 347/722] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:20 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:21.690524 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:21.691542 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:21.699840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:21.700371 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:21.701179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:21.701622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:24.056698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d6abde21-c26d-429a-8d9e-c2bf24bddc64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 24509 microversion: 2.20 time: 2.370546 Dec 09 01:13:24.057506 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 376/723] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:21 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 24509 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:25.068487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:25.069383 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:25.076570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:25.077026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:25.077837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:25.078233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:27.364608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dc7689b5-1ab3-4783-9c2b-d28da89272f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 27405 microversion: 2.20 time: 2.299616 Dec 09 01:13:27.365289 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 348/724] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:25 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 27405 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:28.377576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:28.378531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:28.386436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:28.386888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:28.387665 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:28.388098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:28.483762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5e4fef78-3126-46fd-a349-75893a1af9f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 27676 microversion: 2.20 time: 0.110297 Dec 09 01:13:28.484411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 377/725] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:28 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 27676 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:29.496492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:29.497386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:29.504172 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:29.504625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:29.505401 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:29.505842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:29.613044 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2129ef47-03fd-4116-a1a2-4ef8465805ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 0.121167 Dec 09 01:13:29.613670 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 349/726] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:29 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:30.625582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:30.626612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:30.633419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:30.633869 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:30.634676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:30.635251 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:32.652181 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a8e29d18-d54f-4b09-b525-d0c5a9dabe47 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 2.030472 Dec 09 01:13:32.652837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 378/727] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:30 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:33.664750 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:33.665741 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:33.673004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:33.673452 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:33.674220 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:33.674693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:36.743599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e3805c2b-4945-4f89-83b0-12c3dc9609ca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 3.082670 Dec 09 01:13:36.744731 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 350/728] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:33 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 3085 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:37.756522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:37.757852 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:37.766147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:37.766623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:37.767405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:37.767836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:37.867865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-84a019db-b8d8-41bd-b0f9-f480eeab1ae7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 0.115870 Dec 09 01:13:37.868596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 379/729] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:37 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:38.881494 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:38.882513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:38.889806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:38.890245 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:38.891357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:38.891808 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:41.280891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bf87613f-f0bb-4b85-b238-a1d2984608c2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 2.403158 Dec 09 01:13:41.281565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 351/730] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:38 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:42.297629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:42.299273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:42.308731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:42.309879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:42.311362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:42.311850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:42.416626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b1ae9de3-1af2-479b-9c99-1a3c27e03904 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28183 microversion: 2.20 time: 0.123095 Dec 09 01:13:42.420640 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 380/731] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:42 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:43.428804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:43.429737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:43.438291 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:43.438779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:43.439569 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:43.440010 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:43.537310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fbbcdab7-bc8b-46a9-83de-beffb963b8cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28474 microversion: 2.20 time: 0.112355 Dec 09 01:13:43.541607 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 352/732] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:43 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28474 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:44.550542 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:44.551551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:44.558327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:44.558812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:44.559591 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:44.560029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:44.679273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9448c815-25e9-406d-aa4b-49e5d7e2d13c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28642 microversion: 2.20 time: 0.132746 Dec 09 01:13:44.680178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 381/733] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:44 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28642 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:13:45.586234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-520718665"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:45.586879 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:45.595001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:45.595458 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:45.596230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:45.596664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:45.691839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:45.692840 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:45.701927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:45.702391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:45.703186 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:45.703624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:45.798266 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b7c21d05-9ec5-4a29-9003-59162023ee4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28642 microversion: 2.20 time: 0.110286 Dec 09 01:13:45.802610 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 382/734] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:45 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28642 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:45.893835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.network.security_group_api [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Removing security group 75ee3000-b908-4248-adc8-85a4b88c7e56 from port d892a925-bdcf-416c-aa14-6cbfe415f8eb Dec 09 01:13:46.246959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-024065da-0019-4499-af89-c96550636f9e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.664658 Dec 09 01:13:46.247866 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 353/735] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:13:45 2021] POST /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:46.262413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-b89b5c63-707f-43fa-8170-3b0cb30dd661 req-4829bd85-7848-4ed6-be34-b89ef8cc0cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:46.269595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:13:46.269595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:13:46.285790 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b89b5c63-707f-43fa-8170-3b0cb30dd661 req-4829bd85-7848-4ed6-be34-b89ef8cc0cb7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:46.291347 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-b89b5c63-707f-43fa-8170-3b0cb30dd661 req-4829bd85-7848-4ed6-be34-b89ef8cc0cb7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:46.315857 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-b89b5c63-707f-43fa-8170-3b0cb30dd661 req-4829bd85-7848-4ed6-be34-b89ef8cc0cb7 service nova] Creating event network-changed:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:13:46.332104 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-b89b5c63-707f-43fa-8170-3b0cb30dd661 req-4829bd85-7848-4ed6-be34-b89ef8cc0cb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078665 Dec 09 01:13:46.333331 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 383/736] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:13:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:46.812960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:46.815536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:46.833942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:46.835282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:46.837185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:46.839215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:46.940301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-621b5d8d-d6ad-4a3d-81af-7c2136f1f8e3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28642 microversion: 2.20 time: 0.134153 Dec 09 01:13:46.942079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 354/737] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:46 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28642 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:47.731311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:47.731879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:47.742763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:47.743361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:47.745060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:47.748040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:47.757689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-e9be88d3-fe77-46cd-b6d5-23fe90499628 req-b79b9b0b-84f2-4485-9763-24b5c6de8d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:47.759448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:13:47.759448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:13:47.772519 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-e9be88d3-fe77-46cd-b6d5-23fe90499628 req-b79b9b0b-84f2-4485-9763-24b5c6de8d2c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:47.772970 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-e9be88d3-fe77-46cd-b6d5-23fe90499628 req-b79b9b0b-84f2-4485-9763-24b5c6de8d2c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:47.792164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-e9be88d3-fe77-46cd-b6d5-23fe90499628 req-b79b9b0b-84f2-4485-9763-24b5c6de8d2c service nova] Creating event network-changed:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:13:47.804473 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-e9be88d3-fe77-46cd-b6d5-23fe90499628 req-b79b9b0b-84f2-4485-9763-24b5c6de8d2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050134 Dec 09 01:13:47.806671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 355/738] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:13:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:47.955551 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:47.957445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:47.965869 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:47.966491 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:47.967369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:47.967809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:48.099043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lazy-loading 'services' on Instance uuid 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:13:48.101086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2101a59e-fb88-4348-80bb-c22786cebaf4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 28642 microversion: 2.20 time: 0.151895 Dec 09 01:13:48.101752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 356/739] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:47 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 28642 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:13:48.213379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ede6e251-de8d-49b7-86a5-c58aa3aaf53e tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments/31026095-e261-493b-baf7-f9c9b8f79d81" status: 202 len: 0 microversion: 2.1 time: 0.484794 Dec 09 01:13:48.219820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 384/740] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:13:47 2021] DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments/31026095-e261-493b-baf7-f9c9b8f79d81 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:48.224929 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:48.226185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:48.234457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:48.234457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:48.235450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:48.236109 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:48.278956 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8b013fcb-4735-4480-ba9a-cafd000cf745 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057788 Dec 09 01:13:48.284874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 357/741] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:13:48 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:49.113068 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:49.114147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:49.121197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.121723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.122772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.123213 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.237929 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6d0b2722-aa47-4b6d-8c3e-10282c748fa9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 29133 microversion: 2.20 time: 0.129363 Dec 09 01:13:49.241809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 385/742] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:49 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 29133 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:49.291499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:49.292485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:49.298853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.299247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.300029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.300636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.332421 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-44ee989a-1e1c-4882-84de-7ee8af840efa tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044819 Dec 09 01:13:49.332982 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 358/743] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:13:49 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:13:49.344045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:49.344839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:49.352671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.354174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.354973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:49.355416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:49.441455 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] HTTP exception thrown: Instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 is not attached to volume 31026095-e261-493b-baf7-f9c9b8f79d81 Dec 09 01:13:49.442234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Returning 404 to user: Instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 is not attached to volume 31026095-e261-493b-baf7-f9c9b8f79d81 {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:13:49.443098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5e4b6343-bbb3-462b-a872-a38e95796297 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments/31026095-e261-493b-baf7-f9c9b8f79d81" status: 404 len: 154 microversion: 2.1 time: 0.103948 Dec 09 01:13:49.443897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 386/744] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:13:49 2021] DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4/os-volume_attachments/31026095-e261-493b-baf7-f9c9b8f79d81 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 09 01:13:50.251017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:50.251933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:50.258562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.259016 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.260012 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.260622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.377484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-feb6b6c6-d01a-4575-b627-6c8d6cfabcd5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 30934 microversion: 2.20 time: 0.131396 Dec 09 01:13:50.378305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 359/745] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:50 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 30934 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:50.586263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:50.588010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:50.595602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.596260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.597325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.597983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.624947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:13:50.706497 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-eab6d2eb-52e1-4a2b-ae45-41a5778525c3 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 204 len: 0 microversion: 2.1 time: 0.123051 Dec 09 01:13:50.707521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 387/746] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:13:50 2021] DELETE /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:13:50.717907 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:50.719004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:50.730481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.731329 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.732123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:50.732560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:50.874734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:50.883464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-014aa9a5-e900-4a7a-bf46-540552e8996d tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1554 microversion: 2.1 time: 0.171339 Dec 09 01:13:50.884063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 360/747] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:50 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:51.389673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:51.390863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:51.397221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:51.397756 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:51.398616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:51.399059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:51.498490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-63e279f5-c785-4d2d-8ac3-5ff52cef70a7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 32424 microversion: 2.20 time: 0.112728 Dec 09 01:13:51.499398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 388/748] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:51 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 32424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:51.901547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:51.902161 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:51.908493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:51.908949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:51.909735 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:51.910174 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:52.048305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:52.057012 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f3448c7a-a199-4828-97c4-3d1661df74b9 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1554 microversion: 2.1 time: 0.159836 Dec 09 01:13:52.057575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 361/749] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:51 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:52.509275 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:52.510541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:52.517408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:52.517861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:52.518666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:52.519108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:52.658310 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c9999832-1ef9-4005-a654-01d75c5bb1db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 33516 microversion: 2.20 time: 0.152888 Dec 09 01:13:52.662307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 389/750] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:52 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 33516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:53.076493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:53.077301 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:53.085650 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:53.086235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:53.087053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:53.088017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:53.238894 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ef8627a3a40638168ed0d45c19d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d5beaac0f5499ebdb7f15879cf5c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:13:53.253123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b7b0987a-7d70-46a8-bf23-8fe26e683488 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 200 len: 1554 microversion: 2.1 time: 0.182898 Dec 09 01:13:53.254094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 362/751] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:53 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:13:53.434846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-8d416e77-1a8f-48f5-a9cc-2e06274008a4 req-30f50223-29f2-48ca-bb08-d8c392e8530d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4", "name": "network-vif-deleted", "tag": "d892a925-bdcf-416c-aa14-6cbfe415f8eb"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:53.436234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:13:53.436234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:13:53.444256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-8d416e77-1a8f-48f5-a9cc-2e06274008a4 req-30f50223-29f2-48ca-bb08-d8c392e8530d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:53.444701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-8d416e77-1a8f-48f5-a9cc-2e06274008a4 req-30f50223-29f2-48ca-bb08-d8c392e8530d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:53.458827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-8d416e77-1a8f-48f5-a9cc-2e06274008a4 req-30f50223-29f2-48ca-bb08-d8c392e8530d service nova] Creating event network-vif-deleted:d892a925-bdcf-416c-aa14-6cbfe415f8eb for instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 on hv-cinder-79053 Dec 09 01:13:53.464633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-8d416e77-1a8f-48f5-a9cc-2e06274008a4 req-30f50223-29f2-48ca-bb08-d8c392e8530d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Dec 09 01:13:53.465160 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 390/752] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:13:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:13:53.670775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:53.671800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:53.678209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:53.678821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:53.679683 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:53.680303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:53.783398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2c5c2353-ac08-4548-ae1f-4e60f4dcdc06 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 34539 microversion: 2.20 time: 0.116352 Dec 09 01:13:53.784106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 363/753] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:53 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 34539 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:54.271285 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:54.272221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] [instance: 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:54.278293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:54.279210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:54.279953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:54.280381 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:54.294027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] HTTP exception thrown: Instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 could not be found. Dec 09 01:13:54.294639 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Returning 404 to user: Instance 4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:13:54.295723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-97e58c4e-883a-4120-95d7-cc59052f1908 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4" status: 404 len: 111 microversion: 2.1 time: 0.028717 Dec 09 01:13:54.298113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 391/754] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:13:54 2021] GET /compute/v2.1/servers/4ea596a5-2818-44f6-a0d2-5d5e4b73a6a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:13:54.305628 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c7888ad8-4d78-40aa-a547-10b2742b5319 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] Calling method '.version_select at 0x7fe619e9e5e0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:13:54.326811 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c7888ad8-4d78-40aa-a547-10b2742b5319 tempest-TestMinimumBasicScenario-248909547 tempest-TestMinimumBasicScenario-248909547-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-742202461" status: 202 len: 0 microversion: 2.1 time: 0.025085 Dec 09 01:13:54.327381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 364/755] 10.222.0.23 () {58 vars in 1268 bytes} [Thu Dec 9 01:13:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-742202461 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:54.794942 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:54.796155 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:54.802312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:54.802998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:54.803941 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:54.804538 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:54.905729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8eead410-c6fd-4795-b2c1-ec22178144b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 35513 microversion: 2.20 time: 0.113811 Dec 09 01:13:54.907419 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 392/756] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:54 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 35513 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:55.917806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:55.929711 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:55.940995 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:55.943338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:55.944565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:55.945288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:56.050405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eb6d9df8-beb1-4590-b3be-0ccf135ed94f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 37042 microversion: 2.20 time: 0.136970 Dec 09 01:13:56.051451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 365/757] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:55 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 37042 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:57.062984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:57.064361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:57.072845 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:57.073634 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:57.074481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:57.074925 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:57.181605 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c8312770-063d-44fc-9aa9-50f94b04af02 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 38196 microversion: 2.20 time: 0.121722 Dec 09 01:13:57.186249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 393/758] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:57 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 38196 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:58.195537 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:58.202200 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:58.217326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:58.217671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:58.218481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:58.218923 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:58.317681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b3f9ddf6-0b85-4b75-a8f8-8ef713b1e272 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 38196 microversion: 2.20 time: 0.126940 Dec 09 01:13:58.319521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 366/759] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:58 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 38196 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:13:59.332979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:13:59.334082 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:13:59.342577 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:59.343358 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:59.344326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:13:59.344998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:13:59.434659 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-35e70fdc-2e0c-46bd-9ede-8a1a296f9364 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 38196 microversion: 2.20 time: 0.105947 Dec 09 01:13:59.435324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 394/760] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:13:59 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 38196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:14:00.447179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:00.448209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:00.455046 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:00.455644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:00.456723 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:00.457216 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:00.545508 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-10279e99-3fd0-4279-9468-dc5b6edc03cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 38196 microversion: 2.20 time: 0.102551 Dec 09 01:14:00.546290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 367/761] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:14:00 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 38196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:14:01.561168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:01.562889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:01.571888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:01.572379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:01.573545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:01.573956 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:01.666020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-562a0038-50de-4928-b831-d90c0c8d9d58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 200 len: 38339 microversion: 2.20 time: 0.112321 Dec 09 01:14:01.667038 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 395/762] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:14:01 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 38339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:14:01.677544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:01.678132 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:01.690286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:01.690770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:01.691751 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:01.693066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:01.721016 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d83f75ae-b89c-42b5-b078-14e71c2f9760 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.047122 Dec 09 01:14:01.721791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 368/763] 10.222.0.23 () {60 vars in 1288 bytes} [Thu Dec 9 01:14:01 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:14:02.924157 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:02.925168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:02.932274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:02.932731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:02.933532 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:02.933976 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:02.967786 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f169f267-1604-41a1-82f0-c1f3a8e8fb78 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047553 Dec 09 01:14:02.968363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 396/764] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:14:02 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:03.029153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:03.029704 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:03.035809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.036263 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.037035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.037470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.064923 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Going to try to terminate instance {{(pid=116067) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:14:03.166581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b26e9a54-c1f5-4cfc-a16b-3d423d9ed03b tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 204 len: 0 microversion: 2.1 time: 0.139796 Dec 09 01:14:03.167662 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 369/765] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:14:03 2021] DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:14:03.177129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:03.177921 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:03.193103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.193773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.194838 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.195534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.344867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:03.353362 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-63634074-1112-4e50-b085-c3b93a3a8d66 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1673 microversion: 2.1 time: 0.179556 Dec 09 01:14:03.354897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 397/766] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:03 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:03.955339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:03.956258 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:03.962853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.963552 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.964641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:03.965029 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:03.989156 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lazy-loading 'flavor' on Instance uuid 1515b060-5e76-4152-acbc-e3affaca18e2 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:14:04.265566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e093f491-dd02-4104-8e1f-63e9397c50db tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 202 len: 0 microversion: 2.20 time: 0.314147 Dec 09 01:14:04.266588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 370/767] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:14:03 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 09 01:14:04.275746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:04.276396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:04.284258 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:04.284950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:04.285993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:04.286671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:04.378592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:04.379536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:04.386710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:04.387376 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:04.388442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:04.389384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:04.560411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:04.568737 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:04.573171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:04.574389 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-923deae7-2d64-4e2b-b540-da40bb6dc559 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.303453 Dec 09 01:14:04.574965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 398/768] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:04 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:04.627318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:04.636037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-becff1bc-0251-46c5-8a1c-3052e87d8bd9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1673 microversion: 2.1 time: 0.261735 Dec 09 01:14:04.637157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 371/769] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:04 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1673 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:05.592766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:05.593479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:05.605307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:05.605307 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:05.606172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:05.606708 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:05.656910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:05.658859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:05.672365 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:05.673624 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:05.677038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:05.679706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:05.894586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:05.907428 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:05.909222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:05.915644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b7144286-919e-46d0-90a7-40aa462ef6d9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.326817 Dec 09 01:14:05.919162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 399/770] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:05 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:05.963602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:05.971334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3a02410f-f4dc-4453-8863-8bc3e4d7ce47 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1673 microversion: 2.1 time: 0.321008 Dec 09 01:14:05.972073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 372/771] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:05 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1673 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:06.943762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:06.945110 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:06.954657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:06.955340 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:06.956762 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:06.957427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:06.990221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:06.991651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:07.012177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:07.012643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:07.013453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:07.013897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:07.095705 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:07.106280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2eb0ef8d-99ad-4cb2-b1d1-d87419cf845c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 200 len: 1605 microversion: 2.1 time: 0.120481 Dec 09 01:14:07.107755 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 373/772] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:06 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 1605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:07.164345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:07.173021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:07.174489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:07.175683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e71f2782-b878-4d1d-ac4a-bb3fbfcef5f6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.242529 Dec 09 01:14:07.176246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 400/773] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:06 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:07.420681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-491329993", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:07.490062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] validate_networks() for None {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:14:07.723981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-52b34adf-7c95-4996-9474-190d795f9656 req-75a8a832-6a9d-401d-9749-ce5c8b513472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11e7d82-d6f0-4625-980e-40d38e06de06", "name": "network-vif-deleted", "tag": "bf23067c-8af4-4fb6-9414-19f6cd332b66"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:07.725889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:07.725889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:14:07.735531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-52b34adf-7c95-4996-9474-190d795f9656 req-75a8a832-6a9d-401d-9749-ce5c8b513472 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:07.736028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-52b34adf-7c95-4996-9474-190d795f9656 req-75a8a832-6a9d-401d-9749-ce5c8b513472 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:07.753274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-52b34adf-7c95-4996-9474-190d795f9656 req-75a8a832-6a9d-401d-9749-ce5c8b513472 service nova] Creating event network-vif-deleted:bf23067c-8af4-4fb6-9414-19f6cd332b66 for instance b11e7d82-d6f0-4625-980e-40d38e06de06 on hv-cinder-79053 Dec 09 01:14:07.765693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-52b34adf-7c95-4996-9474-190d795f9656 req-75a8a832-6a9d-401d-9749-ce5c8b513472 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293842 Dec 09 01:14:07.766802 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 401/774] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:08.125566 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:08.126270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:08.137935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.138399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.139175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.139625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.168989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. Dec 09 01:14:08.178799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:14:08.180036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-049a9821-ee86-476c-95f7-3b37d6e5fd88 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 404 len: 111 microversion: 2.1 time: 0.059160 Dec 09 01:14:08.182034 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 402/775] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:08 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:08.192684 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3bbd3a4c-a49d-4411-bf4d-4565f274cef4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '.version_select at 0x7fe61a6dcdc0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:08.244008 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:14:08.244589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:14:08.245091 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:14:08.245688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:14:08.246738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:14:08.260032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.260936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.262397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.263002 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.278294 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3bbd3a4c-a49d-4411-bf4d-4565f274cef4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956893353" status: 202 len: 0 microversion: 2.1 time: 0.091526 Dec 09 01:14:08.284992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 403/776] 10.222.0.23 () {58 vars in 1217 bytes} [Thu Dec 9 01:14:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956893353 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:14:08.295128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:08.297478 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Getting quotas for project 291e12cb103f431eb5b92665f5915c25. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:08.298352 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:08.310201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Getting quotas for user a4b7c405265b4d17843899a57c7ca3d4 and project 291e12cb103f431eb5b92665f5915c25. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:08.313272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.314092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.315091 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:08.315531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:08.335802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:14:08.341966 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:14:08.443289 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d767beb5-4b1e-4079-aa77-c4538a4bf4d7 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025992 Dec 09 01:14:08.443898 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 374/777] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:14:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:14:08.456781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a413f2f9-4431-4983-ad73-6bc046908431 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:08.457402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a413f2f9-4431-4983-ad73-6bc046908431 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:08.605075 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:08.616027 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:08.619444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:08.625264 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f49bc070-2190-48b4-8874-f1fb92df33f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.339051 Dec 09 01:14:08.635182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 404/778] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:08 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:08.676482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a413f2f9-4431-4983-ad73-6bc046908431 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:08.709058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a413f2f9-4431-4983-ad73-6bc046908431 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1214 microversion: 2.1 time: 0.257896 Dec 09 01:14:08.720243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 375/779] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:08 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:09.658676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:09.659309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:09.676513 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: .version_select at 0x7fe619e2f5e0>, body: {"keypair": {"name": "tempest-keypair-1564591808"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:09.677671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:09.678137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:09.678985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:09.679470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:09.706661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:09.715687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:09.811566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:09.817502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:09.840077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fa0cfbbf-6c39-4a2d-8567-b1e175efd941 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.167717 Dec 09 01:14:09.841455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 376/780] 10.222.0.23 () {60 vars in 1157 bytes} [Thu Dec 9 01:14:09 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:09.852613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:09.853235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:09.860338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:09.860795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:09.861602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:09.862046 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:09.900760 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:09.909525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:09.911330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:09.913109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7373ca25-f11b-47b8-bc5a-5ece969e64eb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.261595 Dec 09 01:14:09.914013 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 405/781] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:09 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:09.950053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:09.974975 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6b982503-edf3-446a-89c9-ca01041e5783 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1266 microversion: 2.1 time: 0.122715 Dec 09 01:14:09.976242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 377/782] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:09 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:10.930810 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:10.932067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:10.939166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:10.939989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:10.941227 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:10.941945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:10.994137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:10.995373 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:11.007309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:11.007770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:11.010039 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:11.010507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:11.101610 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:11.110649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-06a66e79-c7b8-42fa-82ca-259030ef70ec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1272 microversion: 2.1 time: 0.120793 Dec 09 01:14:11.112100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 378/783] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:10 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:11.159390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:11.169210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:11.171103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:11.172300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-09db4c82-519f-44e7-8834-89b27bc912ff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.245209 Dec 09 01:14:11.174086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 406/784] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:10 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:12.130526 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:12.131707 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:12.145708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:12.147080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:12.148545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:12.149249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:12.193479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:12.194176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:12.201309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:12.201766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:12.202601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:12.203046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:12.752717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:12.763126 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6eb2aaa4-01e5-46fd-aaf8-60aefe2e4727 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.637631 Dec 09 01:14:12.766734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 379/785] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:12 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:12.795348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:12.807525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:12.814816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:12.816458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7ba76976-8678-4266-b194-f0c35b704515 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.626801 Dec 09 01:14:12.817657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 407/786] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:12 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:12.919272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1559959200", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b0a9c8-a9f0-4971-a73a-1b8741a01fce"}], "security_groups": [{"name": "tempest-securitygroup--885804205"}], "key_name": "tempest-keypair-1564591808", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:13.192426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] validate_networks() for [('56b0a9c8-a9f0-4971-a73a-1b8741a01fce', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:14:13.430701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-9b625090-7fa2-4ab1-a9d8-c45c52ae57db req-5a6a1974-e1ab-4a28-b3f6-87754202069f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d70eb6e-ce1a-499c-8b03-1ccad2d0be03", "tag": "7252d585-2409-4d45-b630-79aea18ae502"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:13.433776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:13.433776 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:14:13.446065 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-9b625090-7fa2-4ab1-a9d8-c45c52ae57db req-5a6a1974-e1ab-4a28-b3f6-87754202069f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:13.446917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-9b625090-7fa2-4ab1-a9d8-c45c52ae57db req-5a6a1974-e1ab-4a28-b3f6-87754202069f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:13.468338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-9b625090-7fa2-4ab1-a9d8-c45c52ae57db req-5a6a1974-e1ab-4a28-b3f6-87754202069f service nova] Creating event network-changed:7252d585-2409-4d45-b630-79aea18ae502 for instance 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 on hv-cinder-79053 Dec 09 01:14:13.473528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-9b625090-7fa2-4ab1-a9d8-c45c52ae57db req-5a6a1974-e1ab-4a28-b3f6-87754202069f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048702 Dec 09 01:14:13.475677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 408/787] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:14:13.802255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:13.806483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:13.814835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:13.815827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:13.816647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:13.817338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:14.328984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:14.337703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-65cc424a-3d69-4710-8aea-59f7701f8aee tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.560093 Dec 09 01:14:14.339433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 409/788] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:13 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:14.351551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:14.353060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:14.359813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:14.360716 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:14.361943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:14.362856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:15.052983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:14:15.067287 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:14:15.068597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:14:15.069890 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:14:15.070685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:14:15.093318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:15.093874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:15.094012 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:15.094831 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:15.095274 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:15.103216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:15.104806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:15.106007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9d955d51-dd49-4f22-b53c-30400f933e3c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.765366 Dec 09 01:14:15.113496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 410/789] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:14 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:15.135827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:15.144246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Getting quotas for user 62defd8645f7454699ee5c7bb5930d16 and project 853a8a131b9d4f239bc6b9dc03642f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:15.172757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:14:15.175275 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:14:15.242210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-160fc259-f098-420f-821d-4860795b4c65 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.328004 Dec 09 01:14:15.244260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 380/790] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:14:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:14:15.254522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ac35b144-9c0f-471a-8989-04a6ca56637a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:15.255508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ac35b144-9c0f-471a-8989-04a6ca56637a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:15.339367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ac35b144-9c0f-471a-8989-04a6ca56637a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:15.347113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ac35b144-9c0f-471a-8989-04a6ca56637a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1238 microversion: 2.1 time: 0.096866 Dec 09 01:14:15.355177 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:15.355793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:15.359276 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 411/791] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:15 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:15.364499 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:15.364844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:15.365640 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:15.366081 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:15.697792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:15.707434 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6ab719b1-42cd-47b8-a7fb-d5b6b62fab87 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.357115 Dec 09 01:14:15.708332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 381/792] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:15 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:16.133413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:16.134063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:16.140706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.141213 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.141998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.142663 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.366690 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:16.368326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:16.376294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.377036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.378031 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.378698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.410227 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:16.421166 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:16.424022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:16.425437 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6c513c66-904d-4035-ae87-eb0994c6428f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.296330 Dec 09 01:14:16.426513 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 412/793] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:16 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:16.506077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:16.514837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5c1ab601-54eb-497c-84dc-c791d4256129 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1298 microversion: 2.1 time: 0.154094 Dec 09 01:14:16.519835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 382/794] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:16 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:16.725479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:16.726474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:16.734734 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.735629 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.736811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:16.737916 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:16.967819 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:16.979489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b1c661a5-3aec-4371-8911-ef91a68dafec tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.258172 Dec 09 01:14:16.980595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 413/795] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:16 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:17.445462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:17.446592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:17.456001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:17.456903 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:17.459566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:17.462160 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:17.532276 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:17.534037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:17.542343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:17.543086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:17.544058 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:17.545265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:17.889082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:17.895543 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:17.938782 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f22bbad6-5ddb-4e36-947b-ad6c28c95650 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.406960 Dec 09 01:14:17.939436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 414/796] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:17 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:17.949705 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:17.949705 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:17.949705 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ea6384d4-946b-466e-9c8a-a5ebd659140c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.503214 Dec 09 01:14:17.950335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 383/797] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:17 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:17.997208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:17.997831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:18.014001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.014758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:18.016025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.018675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:18.116102 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-28634226-eae1-4cf4-9adc-57091150ea7c req-fa91ded3-c9f2-4350-9229-fa99cc14aa01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff79e04-c822-44bc-b9dd-2e0f3b412de7", "tag": "ee3f3652-c539-4795-8d3f-0a54415c13a1"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:18.117639 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:18.117639 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:14:18.139849 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-28634226-eae1-4cf4-9adc-57091150ea7c req-fa91ded3-c9f2-4350-9229-fa99cc14aa01 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.148115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-28634226-eae1-4cf4-9adc-57091150ea7c req-fa91ded3-c9f2-4350-9229-fa99cc14aa01 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:18.189384 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-28634226-eae1-4cf4-9adc-57091150ea7c req-fa91ded3-c9f2-4350-9229-fa99cc14aa01 service nova] Creating event network-changed:ee3f3652-c539-4795-8d3f-0a54415c13a1 for instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 on hv-cinder-79053 Dec 09 01:14:18.204951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-28634226-eae1-4cf4-9adc-57091150ea7c req-fa91ded3-c9f2-4350-9229-fa99cc14aa01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092830 Dec 09 01:14:18.205924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 384/798] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:14:18.495482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-18a94343-8725-499c-a801-eacf4c9b13bf req-33e47515-f82b-4e51-99d1-201e32b0635e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70eb6e-ce1a-499c-8b03-1ccad2d0be03", "name": "network-vif-plugged", "status": "completed", "tag": "7252d585-2409-4d45-b630-79aea18ae502"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:18.498036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:18.498036 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:14:18.519559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-18a94343-8725-499c-a801-eacf4c9b13bf req-33e47515-f82b-4e51-99d1-201e32b0635e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.520379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-18a94343-8725-499c-a801-eacf4c9b13bf req-33e47515-f82b-4e51-99d1-201e32b0635e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:18.546336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-18a94343-8725-499c-a801-eacf4c9b13bf req-33e47515-f82b-4e51-99d1-201e32b0635e service nova] Creating event network-vif-plugged:7252d585-2409-4d45-b630-79aea18ae502 for instance 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 on hv-cinder-79053 Dec 09 01:14:18.559859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-18a94343-8725-499c-a801-eacf4c9b13bf req-33e47515-f82b-4e51-99d1-201e32b0635e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349665 Dec 09 01:14:18.560882 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 385/799] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:18.734208 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:18.748804 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cb25710d-0d27-4c9b-82c1-44fa33edcf1f tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.755382 Dec 09 01:14:18.749599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 415/800] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:17 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:18.967625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:18.968406 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:18.977828 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.978280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:18.979131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:18.979608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:19.033828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Action: 'create', calling method: .version_select at 0x7fe619e2c160>, body: {"keypair": {"name": "tempest-TestShelveInstance-871543306"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:19.050616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:19.056728 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for user eb1a5b2feb8e4f93a4eeb90de9adb927 and project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:19.122616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:19.130337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fda989b4-73fe-4be2-b87d-a25bb4ec49ba tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.170752 Dec 09 01:14:19.130938 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 416/801] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:18 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:19.135576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:19.136832 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:19.143046 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:19.143580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:19.144614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:19.145273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:19.244539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:19.248283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for user eb1a5b2feb8e4f93a4eeb90de9adb927 and project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:19.266667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-35de8801-337b-48a6-a954-4662f07072c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.375959 Dec 09 01:14:19.267272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 386/802] 10.222.0.23 () {60 vars in 1157 bytes} [Thu Dec 9 01:14:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:19.386654 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:19.396106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:19.397820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:19.400210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f33544cf-94b0-4368-8421-c40a97aab726 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.268038 Dec 09 01:14:19.400826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 417/803] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:19 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:19.766223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:19.766983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:19.772862 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:19.773328 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:19.774128 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:19.774734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:20.036697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:20.046595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-be7bf911-2723-4df3-ac16-adf76ad53f8e tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1314 microversion: 2.1 time: 0.284322 Dec 09 01:14:20.047319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 387/804] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:19 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:20.146986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:20.147707 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:20.154135 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:20.154626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:20.155474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:20.155910 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:20.322216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:20.329721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b498c66d-f8dd-4b19-98af-4611cc33ac14 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.186419 Dec 09 01:14:20.330515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 418/805] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:20 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:20.418463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:20.419075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:20.424727 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:20.425191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:20.425996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:20.426485 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:20.563437 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:20.572283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:20.574235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:20.575495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c646cf70-cc1d-4894-bc65-a7a82405092e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1744 microversion: 2.20 time: 0.161125 Dec 09 01:14:20.576099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 388/806] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:20 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:21.064615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:21.065161 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:21.071430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.071979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.072771 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.073218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.207411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.216368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b732421c-4c63-4415-9733-3b0067a8f22b tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1463 microversion: 2.1 time: 0.155321 Dec 09 01:14:21.216791 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 419/807] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:21 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:21.253566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:21.254063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:21.260432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.260880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.261654 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.262092 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.286479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Going to try to terminate instance {{(pid=116067) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:14:21.347368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:21.348009 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:21.355198 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.355656 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.356676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.357434 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.387375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7b4af28c-b995-468e-bdca-395b5e5fd19a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 204 len: 0 microversion: 2.1 time: 0.137128 Dec 09 01:14:21.390996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 389/808] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:14:21 2021] DELETE /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:14:21.397000 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:21.397802 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:21.405351 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.405931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.406945 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.407465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.580689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.593143 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5c228ca1-ddda-486e-a55e-8de50fba3026 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.249176 Dec 09 01:14:21.593871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 420/809] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:21 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:21.606700 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.607368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:21.607978 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:21.613657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.614013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-aaa63fa7-24d8-4dfe-bafe-502bc27d05a4 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1469 microversion: 2.1 time: 0.221657 Dec 09 01:14:21.614119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.614611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 390/810] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:21 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:21.614904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:21.615333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:21.761517 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.770225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.772305 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:21.774003 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ddf6ec74-ed5c-425e-99ab-9878660a52fb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1744 microversion: 2.20 time: 0.170277 Dec 09 01:14:21.774870 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 421/811] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:21 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:22.610226 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:22.610904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:22.616966 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:22.621127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:22.621986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:22.622472 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:22.631467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:22.632093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:22.641452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:22.643911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:22.647483 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:22.664131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:22.972876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:22.983045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8db29321-0e64-484e-a554-dc843b20df3a tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1469 microversion: 2.1 time: 0.355021 Dec 09 01:14:22.987666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 422/812] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:22 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:22.995416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:22.996881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:23.014284 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:23.023795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-02b99a7a-6fc1-4e72-a4d0-81698f143263 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.415817 Dec 09 01:14:23.024878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 391/813] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:22 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:23.029272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:23.029893 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:23.030898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:23.031490 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:23.176630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:23.185481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:23.187005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:23.190309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cdc0a474-e81f-441e-b37c-d7bb5e8e00cc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.200837 Dec 09 01:14:23.191052 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 423/814] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:22 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:24.022881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:24.024400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:24.043772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.044512 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.045720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.046598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.172912 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-0505e188-8c32-48f2-9597-7726c159cb33 req-e30b6a88-db43-44f4-9b44-9afffcb63756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d70eb6e-ce1a-499c-8b03-1ccad2d0be03", "name": "network-vif-deleted", "tag": "7252d585-2409-4d45-b630-79aea18ae502"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:24.174569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:24.174569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:14:24.197278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-0505e188-8c32-48f2-9597-7726c159cb33 req-e30b6a88-db43-44f4-9b44-9afffcb63756 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.197527 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-0505e188-8c32-48f2-9597-7726c159cb33 req-e30b6a88-db43-44f4-9b44-9afffcb63756 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.221944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b7c405265b4d17843899a57c7ca3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '291e12cb103f431eb5b92665f5915c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:24.223541 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-0505e188-8c32-48f2-9597-7726c159cb33 req-e30b6a88-db43-44f4-9b44-9afffcb63756 service nova] Creating event network-vif-deleted:7252d585-2409-4d45-b630-79aea18ae502 for instance 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 on hv-cinder-79053 Dec 09 01:14:24.241191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-75e73b49-505d-432a-b0c7-1db80406de07 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 200 len: 1427 microversion: 2.1 time: 0.243767 Dec 09 01:14:24.244699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 392/815] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:23 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:24.249296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:24.249943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:24.255361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-0505e188-8c32-48f2-9597-7726c159cb33 req-e30b6a88-db43-44f4-9b44-9afffcb63756 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237049 Dec 09 01:14:24.261962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 424/816] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:24.267330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.267793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.268609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.269055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.277784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:24.277784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:24.296470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.296989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.302154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.302819 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.605310 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:24.617004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:24.623199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:24.624619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-513840d9-1170-4bb3-8b44-e18733f5598a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.360619 Dec 09 01:14:24.628845 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 425/817] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:24 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:24.660163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-76753cf2-6868-4404-b386-56e945a40855 req-8deb8529-9994-48db-98d8-d46eea56d655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "name": "network-vif-plugged", "status": "completed", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:24.661863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:24.661863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:14:24.681149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-76753cf2-6868-4404-b386-56e945a40855 req-8deb8529-9994-48db-98d8-d46eea56d655 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:24.683465 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-76753cf2-6868-4404-b386-56e945a40855 req-8deb8529-9994-48db-98d8-d46eea56d655 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:24.717701 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-76753cf2-6868-4404-b386-56e945a40855 req-8deb8529-9994-48db-98d8-d46eea56d655 service nova] Creating event network-vif-plugged:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:14:24.730152 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:24.750408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6cd24874-7841-43fa-a6ed-8279dec18de0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.504417 Dec 09 01:14:24.751352 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-76753cf2-6868-4404-b386-56e945a40855 req-8deb8529-9994-48db-98d8-d46eea56d655 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096137 Dec 09 01:14:24.755391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 393/818] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:24 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:24.756142 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 426/819] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:25.275014 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:25.279635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] [instance: 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:25.286314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.287061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.288026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.288625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.307961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] HTTP exception thrown: Instance 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 could not be found. Dec 09 01:14:25.308566 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] Returning 404 to user: Instance 5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:14:25.309398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-21ec30c1-9bc0-4463-8baf-1575cc905c58 tempest-VolumesNegativeTest-764482643 tempest-VolumesNegativeTest-764482643-project] 10.222.0.23 "GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03" status: 404 len: 111 microversion: 2.1 time: 0.040227 Dec 09 01:14:25.317724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 427/820] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:25 2021] GET /compute/v2.1/servers/5d70eb6e-ce1a-499c-8b03-1ccad2d0be03 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:14:25.650398 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:25.651621 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:25.673181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.673939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.674931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.675541 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.777009 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:25.777671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:25.786308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.786902 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.787783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:25.788299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:25.927974 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:25.939094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:25.941089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:25.942567 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-00016e2c-4af8-4076-b59f-d5f01d3d6810 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.299203 Dec 09 01:14:25.955387 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 394/821] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:25 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:26.025040 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:26.036936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0ca621e3-9738-4b93-a05d-3ba83d046b9f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.267428 Dec 09 01:14:26.037487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 428/822] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:25 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:26.813463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-067a2025-fbc0-4a24-84b3-f53355aaf254 req-140a8634-633d-4f22-bba0-6836e6ec8c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff79e04-c822-44bc-b9dd-2e0f3b412de7", "name": "network-vif-plugged", "status": "completed", "tag": "ee3f3652-c539-4795-8d3f-0a54415c13a1"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:26.815608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:26.815608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:14:26.824335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-067a2025-fbc0-4a24-84b3-f53355aaf254 req-140a8634-633d-4f22-bba0-6836e6ec8c25 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:26.826204 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-067a2025-fbc0-4a24-84b3-f53355aaf254 req-140a8634-633d-4f22-bba0-6836e6ec8c25 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:26.839191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-067a2025-fbc0-4a24-84b3-f53355aaf254 req-140a8634-633d-4f22-bba0-6836e6ec8c25 service nova] Creating event network-vif-plugged:ee3f3652-c539-4795-8d3f-0a54415c13a1 for instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 on hv-cinder-79053 Dec 09 01:14:26.847868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-067a2025-fbc0-4a24-84b3-f53355aaf254 req-140a8634-633d-4f22-bba0-6836e6ec8c25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047702 Dec 09 01:14:26.851935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 395/823] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:26.962117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:26.963738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:26.975818 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:26.980546 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:26.984055 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:26.984516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:27.056197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:27.056900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:27.068742 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:27.069435 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:27.070658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:27.071943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:27.321063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:27.334800 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:27.337445 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:27.338992 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c3dc5052-64f7-426f-b36f-7351c852aa88 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.381521 Dec 09 01:14:27.353113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 429/824] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:26 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:27.383761 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:27.397732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0c755a03-c8bb-4e32-9bff-3f3e08e84b09 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.345986 Dec 09 01:14:27.402152 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 396/825] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:27 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:28.358523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:28.359174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:28.365633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:28.366093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:28.367522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:28.368049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:28.418933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:28.419620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:28.443337 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:28.444080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:28.446073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:28.446545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:28.614422 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:28.628428 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:28.631540 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:28.633288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2e9ce1bf-c1bc-4bc7-a6d0-648a66e0f594 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.279035 Dec 09 01:14:28.645296 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 430/826] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:28 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:28.689322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:28.698525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6c5556ad-d19a-4d38-a54d-c41bd47bedbe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1363 microversion: 2.1 time: 0.284368 Dec 09 01:14:28.700280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 397/827] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:28 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:29.652133 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:29.653608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:29.659784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.660427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:29.661405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.661876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:29.717227 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:29.718633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:29.727229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.728141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:29.729488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.730058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:29.851085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:29.861017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:29.862781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:29.864151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-94c1a740-92b4-44f3-a24e-d2eb27280fd9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.216657 Dec 09 01:14:29.878400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 431/828] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:29 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:29.948256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:29.956035 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b777225f-c4d1-4bb4-a718-3f28600dfd6a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1549 microversion: 2.1 time: 0.242759 Dec 09 01:14:29.957498 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 398/829] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:29 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1549 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:29.975234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:29.977347 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:29.987514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.988131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:29.988933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:29.989375 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:30.090520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2ee71fe9-0a7c-4675-a338-f8844341751e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118732 Dec 09 01:14:30.091927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 432/830] 10.222.0.23 () {58 vars in 1274 bytes} [Thu Dec 9 01:14:29 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:30.897024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:30.897635 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:30.916030 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:30.916574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:30.917452 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:30.917891 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:31.089405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:31.098084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:31.099584 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:31.100733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-135ade45-050a-460b-bca4-21548672a72f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.207650 Dec 09 01:14:31.102086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 399/831] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:30 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:31.251996 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:31.253183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:31.254622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-916fb792-f102-49b4-a896-b2d67da88e0e req-d26fdb74-4ed7-4986-b44b-fba62ef57a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff79e04-c822-44bc-b9dd-2e0f3b412de7", "tag": "ee3f3652-c539-4795-8d3f-0a54415c13a1"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:31.256682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:31.256682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:14:31.261820 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:31.262606 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:31.263746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:31.264387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:31.270830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-916fb792-f102-49b4-a896-b2d67da88e0e req-d26fdb74-4ed7-4986-b44b-fba62ef57a9c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:31.271612 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-916fb792-f102-49b4-a896-b2d67da88e0e req-d26fdb74-4ed7-4986-b44b-fba62ef57a9c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:31.286142 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-916fb792-f102-49b4-a896-b2d67da88e0e req-d26fdb74-4ed7-4986-b44b-fba62ef57a9c service nova] Creating event network-changed:ee3f3652-c539-4795-8d3f-0a54415c13a1 for instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 on hv-cinder-79053 Dec 09 01:14:31.293242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-916fb792-f102-49b4-a896-b2d67da88e0e req-d26fdb74-4ed7-4986-b44b-fba62ef57a9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042847 Dec 09 01:14:31.301634 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 400/832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:31.393423 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b0b5071e-eeae-4636-9eda-8a12994e71cb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.150159 Dec 09 01:14:31.394070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 433/833] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:31 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:32.123061 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:32.124507 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:32.131902 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:32.132773 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:32.133797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:32.134526 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:32.315553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:32.325357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:32.327112 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:32.329265 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ada8a349-6c69-4ff4-abdb-d16636f3dce6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.209749 Dec 09 01:14:32.330089 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 401/834] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:32 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:32.405400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:32.406441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:32.413300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:32.414392 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:32.415194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:32.415637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:32.507182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ea87abca-d036-42d6-8724-c453aee03f71 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.105360 Dec 09 01:14:32.507959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 434/835] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:32 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:33.348511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:33.350214 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:33.364630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:33.365393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:33.369025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:33.369701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:33.520772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:33.522673 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:33.541227 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:33.541864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:33.542826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:33.544274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:33.566418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:33.581709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:33.583464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:33.590076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8e253bce-9df6-46d4-9716-c0baad0a589f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1739 microversion: 2.20 time: 0.244985 Dec 09 01:14:33.590708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 402/836] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:33 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:33.642333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8d728b77-f790-4223-8227-b31c1f91dacb tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.127795 Dec 09 01:14:33.643086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 435/837] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:33 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:34.610806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:34.611475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:34.618055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:34.618571 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:34.619364 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:34.619808 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:34.658736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:34.659871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:34.667935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:34.668383 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:34.669178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:34.669619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:34.760464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9089c914-0df8-46d0-8ec2-023babc67afe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.109545 Dec 09 01:14:34.761117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 436/838] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:34 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:14:34.859804 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:34.871355 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:34.874757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:34.877003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5a63049d-0acd-4194-8de9-67dca1edd36a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1721 microversion: 2.20 time: 0.269584 Dec 09 01:14:34.878144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 403/839] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:34 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:35.771865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:35.772940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:35.779862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:35.780308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:35.781098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:35.781516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:35.887827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fa929741-89d3-48a1-9563-0663c8d96616 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.119702 Dec 09 01:14:35.888581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 437/840] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:35 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:35.896739 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:35.897361 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:35.904077 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:35.904536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:35.905322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:35.905773 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:36.037608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:36.046076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:36.047642 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:36.048785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-04b337b2-8d7c-489b-a65e-02e206b91c94 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1721 microversion: 2.20 time: 0.155745 Dec 09 01:14:36.049343 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 404/841] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:35 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:36.900805 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:36.902351 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:36.912302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:36.912781 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:36.914646 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:36.915093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:37.017053 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-de0bceca-4240-427d-aced-bd1eae19291f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.120999 Dec 09 01:14:37.017703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 438/842] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:36 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:37.067279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:37.067883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:37.074755 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:37.075190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:37.075962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:37.076395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:37.224594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:37.233278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:37.234780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:37.235919 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e2eb794d-485c-4c9f-b77b-f39f194668ea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1721 microversion: 2.20 time: 0.172312 Dec 09 01:14:37.236482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 405/843] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:37 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:38.015735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-8c8b9590-308f-4301-89d9-4e439f3214e7 req-017a42b5-2ad4-4442-908d-496e23d43fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "name": "network-vif-unplugged", "status": "completed", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:38.017452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:38.017452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:14:38.029295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-8c8b9590-308f-4301-89d9-4e439f3214e7 req-017a42b5-2ad4-4442-908d-496e23d43fbd service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.029764 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:38.030006 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-8c8b9590-308f-4301-89d9-4e439f3214e7 req-017a42b5-2ad4-4442-908d-496e23d43fbd service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.031487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.044528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.compute.server_external_events [req-8c8b9590-308f-4301-89d9-4e439f3214e7 req-017a42b5-2ad4-4442-908d-496e23d43fbd service nova] Unable to find a host for instance 1515b060-5e76-4152-acbc-e3affaca18e2. Dropping event network-vif-unplugged {{(pid=116068) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 09 01:14:38.045395 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-8c8b9590-308f-4301-89d9-4e439f3214e7 req-017a42b5-2ad4-4442-908d-496e23d43fbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034009 Dec 09 01:14:38.045969 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 439/844] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 09 01:14:38.051006 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.051467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.052440 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.052888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.056367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-822139222", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-871543306", "security_groups": [{"name": "tempest-secgroup-smoke-299829129"}], "networks": [{"uuid": "f10b420b-f882-4844-b296-4fbc97188815"}], "block_device_mapping_v2": [{"uuid": "e2daabd9-4aaa-4ec1-b0bd-ea593cef409e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:38.131944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1cbc4b58-74e0-48ea-85ac-c80c60d01919 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.108066 Dec 09 01:14:38.132686 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 406/845] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:38 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:14:38.170246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] validate_networks() for [('f10b420b-f882-4844-b296-4fbc97188815', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:14:38.254765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:38.255371 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.261899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.262345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.263262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.263695 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.428370 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:38.436345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:38.437820 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:38.438994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7a3150d4-d5a7-4d55-86f2-5de80025d30c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1664 microversion: 2.20 time: 0.188366 Dec 09 01:14:38.439545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 407/846] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:38 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1664 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:38.455621 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72515415-726b-4c3e-8d10-23dc79600813"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:38.456650 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.462988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.463588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.464432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.464795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.665462 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:14:38.665933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:14:38.666697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:14:38.667341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:14:38.667901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:14:38.681179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.681624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.682459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.682901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.701948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:14:38.705827 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Getting quotas for user eb1a5b2feb8e4f93a4eeb90de9adb927 and project b9af91ce42164b7d8dbeecc27f4698e8. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:14:38.750906 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-944f2c80-5640-491b-8a2e-73dd157bd6a3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298704 Dec 09 01:14:38.752066 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 408/847] 10.222.0.23 () {62 vars in 1363 bytes} [Thu Dec 9 01:14:38 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:14:38.765666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:14:38.767973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2daabd9-4aaa-4ec1-b0bd-ea593cef409e',volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:14:38.863114 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:38.863812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.870194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.870685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.871489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.871900 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.896364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ac922491-c2c4-4506-9770-c14a565f0fb6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.844414 Dec 09 01:14:38.901871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 440/848] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:14:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 09 01:14:38.907332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cf857682-d714-4f28-af5e-26866062e7f2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:38.907942 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cf857682-d714-4f28-af5e-26866062e7f2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.967319 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cf857682-d714-4f28-af5e-26866062e7f2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:38.971437 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7a28024e-d900-42c5-81f6-5616ca73658b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action" status: 202 len: 0 microversion: 2.20 time: 0.112019 Dec 09 01:14:38.972427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 409/849] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:14:38 2021] POST /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 09 01:14:38.977286 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cf857682-d714-4f28-af5e-26866062e7f2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1087 microversion: 2.1 time: 0.072604 Dec 09 01:14:38.977476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 441/850] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:38 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:38.980868 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:38.981617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:38.988304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.988862 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:38.989715 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:38.990225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:39.147319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:39.150136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:39.151343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:39.159976 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:39.160865 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:39.161438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:39.161929 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:39.162644 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:39.163212 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:39.163449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-977e7eab-2511-4c51-a9cf-87c31b071987 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1750 microversion: 2.20 time: 0.187215 Dec 09 01:14:39.164189 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 410/851] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:38 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:39.262137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7d40a4ad-0a91-469b-bccc-d60e7c321289 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.122344 Dec 09 01:14:39.265569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 442/852] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:39 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:14:39.992881 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:39.993489 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:40.000115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.000575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.001369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.001828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.104095 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:40.111569 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f481e706-cdce-4348-909b-167143111749 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1193 microversion: 2.1 time: 0.122332 Dec 09 01:14:40.112229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 411/853] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:39 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1193 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:40.184913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:40.185694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:40.193667 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.194115 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.195029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.195464 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.272503 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:40.273481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:40.279310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.279760 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.280527 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:40.281141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:40.361346 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0520bd86-516f-4771-a601-2a86452ee7fa tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.092143 Dec 09 01:14:40.361995 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 412/854] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:40 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:14:40.667408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:40.676190 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:40.677874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:40.679430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4e8f9bc6-e7a4-4a87-bc57-45ae6b56e755 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1752 microversion: 2.20 time: 0.500662 Dec 09 01:14:40.679999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 443/855] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:40 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1752 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:41.131040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:41.131767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:41.141745 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.142538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.143338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.143780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.374311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:41.375730 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:41.383991 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.385590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.386817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.387336 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.479002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-dae8021a-7889-4a03-a5ac-a462023833cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 14 microversion: 2.1 time: 0.109737 Dec 09 01:14:41.479649 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 444/856] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:41 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 09 01:14:41.483199 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:41.491183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-34da9f87-5945-41fb-990b-506250f70e98 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1270 microversion: 2.1 time: 0.365098 Dec 09 01:14:41.502336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 413/857] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:41 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1270 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:41.700321 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:41.701113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:41.708322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.708809 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.709873 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.710553 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.944392 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-9dd84528-7423-465f-8385-9c1bc84100bb req-0c57b6cb-7dcb-4ea1-b1e5-d71622509267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:41.950319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:14:41.950319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:14:41.966385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9dd84528-7423-465f-8385-9c1bc84100bb req-0c57b6cb-7dcb-4ea1-b1e5-d71622509267 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:41.966910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-9dd84528-7423-465f-8385-9c1bc84100bb req-0c57b6cb-7dcb-4ea1-b1e5-d71622509267 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:41.975514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:41.985467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-9dd84528-7423-465f-8385-9c1bc84100bb req-0c57b6cb-7dcb-4ea1-b1e5-d71622509267 service nova] Creating event network-changed:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:14:41.990782 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-9dd84528-7423-465f-8385-9c1bc84100bb req-0c57b6cb-7dcb-4ea1-b1e5-d71622509267 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051756 Dec 09 01:14:41.991215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 414/858] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:14:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:14:41.996163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:41.998184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:41.999594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-26d72e63-2081-44f1-a3e1-d7e883dc70d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.304098 Dec 09 01:14:42.004434 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 445/859] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:41 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:42.490313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:42.492366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:42.500025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:42.500878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:42.502215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:42.504836 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:42.515763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:42.516598 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:42.532411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:42.533748 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:42.537608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:42.546273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:42.728005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:42.739369 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e56f3cfb-c37b-433d-adfa-985a15643235 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.233190 Dec 09 01:14:42.739877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 446/860] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:42 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:43.018054 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:43.018608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:43.024473 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:43.025576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:43.026412 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:43.026854 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:43.180760 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:43.189899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:43.191390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:43.192539 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0e65e11c-5ab2-4134-8dea-f2775c09b61d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.178244 Dec 09 01:14:43.193091 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 447/861] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:43 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:43.755970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:43.756604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:43.763223 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:43.763744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:43.764492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:43.765172 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:43.906487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:43.913919 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3219a1a0-9c97-42bd-b12e-4cb340892c42 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.161578 Dec 09 01:14:43.914608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 448/862] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:43 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:44.211475 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:44.212853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:44.220073 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:44.220631 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:44.221436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:44.221871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:44.364252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:44.373433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:44.374981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:44.376140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d4d442b3-7214-4cf5-ab07-04dda05e62c0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.168510 Dec 09 01:14:44.376740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 449/863] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:44 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:44.932056 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:44.934380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:44.940587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:44.941332 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:44.942207 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:44.942745 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:45.086184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:45.094623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1340e21d-e916-4eb2-bcb5-19a41777fa51 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.166211 Dec 09 01:14:45.095257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 450/864] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:44 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:45.395139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:45.395742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:45.402636 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:45.403123 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:45.403897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:45.404335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:45.563716 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:45.572516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:45.573994 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:45.575159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-358ea6e9-c0f4-4500-a5b4-d14e370bb808 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.183770 Dec 09 01:14:45.575720 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 451/865] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:45 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:46.112407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:46.113038 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:46.119288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:46.120021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:46.120807 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:46.121250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:46.278886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:46.286178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-66a83989-a2d0-4afa-88cc-e5562183f229 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.177480 Dec 09 01:14:46.286775 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 452/866] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:46 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:46.593443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:46.594062 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:46.601911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:46.602399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:46.603753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:46.604333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:46.743420 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:46.751723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:46.753205 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:46.754347 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4477cf9b-35bb-44d3-820a-c54bb51e290e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.164661 Dec 09 01:14:46.754934 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 453/867] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:46 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:47.302547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:47.303297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:47.309309 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:47.309763 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:47.310594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:47.311043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:47.457036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:47.464610 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a86922f1-f79f-49c2-b158-7581a8428b35 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.165685 Dec 09 01:14:47.465176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 454/868] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:47 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:47.772478 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:47.773092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:47.780436 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:47.780897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:47.781730 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:47.782195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:47.932170 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:47.944151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:47.946059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:47.947932 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2a0cd566-e869-46f2-9b58-2407319ef3f8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.179191 Dec 09 01:14:47.948508 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 455/869] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:47 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:48.481484 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:48.482146 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:48.487922 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:48.488369 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:48.489149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:48.489580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:48.633175 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:48.640751 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-afefb6a3-6794-4d7c-8243-0fa19ef7d193 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.163533 Dec 09 01:14:48.641314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 456/870] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:48 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:48.968080 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:48.968679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:48.975164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:48.975612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:48.976400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:48.976936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:49.115280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:49.123931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:49.125399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:49.126567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c2f6bf8f-f568-4777-9840-c9e333c8f200 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.162529 Dec 09 01:14:49.127124 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 457/871] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:48 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:49.656914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:49.657551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:49.663456 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:49.663903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:49.664671 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:49.665104 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:49.809217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:49.816778 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e869138d-cc69-45aa-8db6-eab6bbc19e60 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.163574 Dec 09 01:14:49.817545 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 458/872] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:49 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:50.144801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:50.145414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:50.151784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:50.152243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:50.153039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:50.153481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:50.300084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:50.309537 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:50.311066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:50.312253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b725b4d8-af0a-4234-a8ea-bea09140bd0d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.171132 Dec 09 01:14:50.312812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 459/873] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:50 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:50.841339 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:50.842149 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:50.864521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:50.865076 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:50.865965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:50.866536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:51.013078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:51.020681 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4ad6371e-e306-4ca1-b2e5-99cb943b8457 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.191287 Dec 09 01:14:51.021326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 460/874] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:50 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:51.330386 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:51.331018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:51.337440 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:51.338146 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:51.339633 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:51.340185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:51.482061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:51.491085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:51.492573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:51.493742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5432ff50-10fd-47d0-b0de-4442a7cf7153 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.167136 Dec 09 01:14:51.494303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 461/875] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:51 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:52.037489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:52.038206 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:52.044302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:52.044749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:52.045523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:52.045958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:52.190069 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:52.197534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1098fb1f-706d-4a1e-8abc-fdf66ec2f47d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.163895 Dec 09 01:14:52.198174 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 462/876] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:52 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:52.512698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:52.513217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:52.519783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:52.520229 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:52.521033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:52.521489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:52.686626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:52.695037 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:52.696561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:52.697713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7c5cfd12-edb8-4602-8966-2dd30abbb256 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.189052 Dec 09 01:14:52.698670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 463/877] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:52 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:53.215934 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:53.216551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:53.222385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:53.222843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:53.223615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:53.224044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:53.354780 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:53.362188 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-287904e0-1685-4abd-9963-fe92352515f4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.150884 Dec 09 01:14:53.362727 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 464/878] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:53 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:14:53.716178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:53.716699 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:53.722986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:53.723438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:53.724210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:53.724642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:53.884549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:53.892733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:53.894236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:53.895502 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-163a92b3-cab7-4211-b672-b4d6c809fda2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.183414 Dec 09 01:14:53.896063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 465/879] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:53 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:53.910455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eadc4e59-49b3-4305-8a36-7cce56d471b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28184 microversion: 2.1 time: 11.424490 Dec 09 01:14:53.911099 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 415/880] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:42 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28184 bytes in 11426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:14:54.380441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:54.381072 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:54.388197 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.388659 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:54.389456 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.389901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:54.537948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:54.545609 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-92244e1c-df74-4bbc-a986-ce74714fd8ea tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.169282 Dec 09 01:14:54.546404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 466/881] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:54 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:54.913385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:54.914073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:54.921955 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:54.922982 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:54.923215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.923668 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:54.924505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.924883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:54.929248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.929698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:54.930514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:54.930950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:55.027714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3c883ece-4ab6-499f-9d71-468147760579 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28184 microversion: 2.1 time: 0.110165 Dec 09 01:14:55.028587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 467/882] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:54 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:14:55.068706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:55.077732 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:55.079277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:55.080426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-44567852-a98f-4293-af5c-45bb7616efc1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.171112 Dec 09 01:14:55.080976 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 416/883] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:54 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:55.563290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:55.563998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:55.571625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:55.572069 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:55.573022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:55.573815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:55.709163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:55.717467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5915e123-d3f4-4f1e-908b-f8682fa16fc4 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.158908 Dec 09 01:14:55.718050 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 468/884] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:55 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:56.039218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:56.040130 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:56.046966 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.047417 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.048192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.048630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.098569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:56.099106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:56.105556 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.105956 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.106779 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.107219 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.143063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ec420bf7-41ba-449b-a764-2c6fcf0de0d2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28475 microversion: 2.1 time: 0.107339 Dec 09 01:14:56.143872 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 417/885] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:56 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28475 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:14:56.241710 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:56.250509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:56.252012 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:56.253163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f8993e7e-1087-430c-a14e-e3111f50ee7b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.158400 Dec 09 01:14:56.253719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 469/886] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:56 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:14:56.734796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:56.735493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:56.742256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.742730 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.743511 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:56.743952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:56.880242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:56.888746 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4bbdb69a-993c-4ca4-b6f7-09cd2e9f9f91 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.157760 Dec 09 01:14:56.889643 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 418/887] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:56 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:57.155283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:57.156302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:57.162857 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.163306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:57.164091 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.164526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:57.258561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-245693f0-3029-4cf0-8598-3007049009f8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28642 microversion: 2.1 time: 0.107307 Dec 09 01:14:57.259219 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 470/888] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:57 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28642 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:14:57.270935 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:57.271544 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:57.278647 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.279423 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:57.280345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.280787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:57.416712 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:57.425116 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:57.426633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:57.427773 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bd0260b4-82af-44aa-b32a-cad3ed7eb342 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.160449 Dec 09 01:14:57.428321 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 419/889] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:57 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:57.911209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:57.911915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:57.919601 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.920063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:57.920904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:57.921344 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:58.052856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:58.061158 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-830c14fb-e9e9-49a8-95f3-6c9bc6d3a82d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.154064 Dec 09 01:14:58.061743 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 471/890] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:57 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:58.271979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:58.273207 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:58.280110 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:58.280560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:58.281326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:58.281758 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:58.364004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9e1d662d-730f-404c-883e-73860ccb94e5 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28642 microversion: 2.1 time: 0.096442 Dec 09 01:14:58.364679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 420/891] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:58 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28642 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:14:58.445533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:58.446173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:58.452998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:58.453444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:58.454216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:58.454675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:58.588525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:58.596736 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:58.598244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:58.599411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-14e77385-eaca-4803-849f-7c3db4100c9a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.157565 Dec 09 01:14:58.600096 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 472/892] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:58 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:14:59.078178 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:59.078897 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:59.085877 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.086327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.087128 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.087566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.218575 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:59.226149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ee2c7bbb-4b56-4ffe-bdba-58e5087ec9c2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.152218 Dec 09 01:14:59.226750 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 421/893] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:14:59 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:14:59.375641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:14:59.376550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:59.382862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.383305 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.384079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.384511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.491308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8a6e7348-7507-436e-8245-eaca23cd75e9 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 28642 microversion: 2.1 time: 0.119065 Dec 09 01:14:59.491943 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 473/894] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:14:59 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 28642 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:14:59.618389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:14:59.618989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:14:59.625247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.625689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.626484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:14:59.626922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:14:59.757951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:59.767106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:59.768589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:14:59.769747 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-664f765a-77f0-4083-9854-967b5f8b2f37 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.155097 Dec 09 01:14:59.770314 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 422/895] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:14:59 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:00.243698 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:00.244396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:00.252053 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.252502 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.253273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.253706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.387993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:00.395259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ea42a0d4-2824-439f-9894-e38647dd2353 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.155547 Dec 09 01:15:00.395828 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 474/896] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:00 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:00.502967 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:00.503883 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:00.510697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.511153 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.512217 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.512660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.621386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0d30ab10-f9ea-407d-b933-363b8fa798a1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 29003 microversion: 2.1 time: 0.121300 Dec 09 01:15:00.622486 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 423/897] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:00 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 29003 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:00.787552 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:00.788165 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:00.795136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.795589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.796373 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:00.796815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:00.933430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:00.941680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:00.943199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:00.944337 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9e6caf7f-30e9-4481-a18f-066d8563bb15 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.160571 Dec 09 01:15:00.944885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 475/898] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:00 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:01.412297 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:01.412989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:01.419944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.420395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:01.421162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.421597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:01.562502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:01.569696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b5bbb306-03f9-46af-acba-ca9ac6310c54 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.161421 Dec 09 01:15:01.570259 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 424/899] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:01 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:01.632470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:01.633402 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:01.640246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.640692 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:01.641465 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.641898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:01.734702 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b5e0e907-9321-4086-9ae7-22dfee688632 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 31144 microversion: 2.1 time: 0.105531 Dec 09 01:15:01.735289 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 476/900] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:01 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 31144 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:01.963833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:01.964460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:01.970780 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.971227 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:01.972015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:01.972433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.104829 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:02.115103 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:02.116613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:02.117784 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fbbf28db-9069-4ad9-a307-27f437fb7eca tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.158362 Dec 09 01:15:02.118651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 425/901] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:01 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:02.494330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-513d4b4c-eccb-465f-ba34-88e6f1846865 req-27a35a32-2df8-41fb-8d09-addecf40a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "name": "network-vif-plugged", "status": "completed", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:02.495899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:02.495899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:15:02.503994 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-513d4b4c-eccb-465f-ba34-88e6f1846865 req-27a35a32-2df8-41fb-8d09-addecf40a5cd service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:02.504442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-513d4b4c-eccb-465f-ba34-88e6f1846865 req-27a35a32-2df8-41fb-8d09-addecf40a5cd service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.516340 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-513d4b4c-eccb-465f-ba34-88e6f1846865 req-27a35a32-2df8-41fb-8d09-addecf40a5cd service nova] Creating event network-vif-plugged:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:15:02.520956 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-513d4b4c-eccb-465f-ba34-88e6f1846865 req-27a35a32-2df8-41fb-8d09-addecf40a5cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Dec 09 01:15:02.521558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 477/902] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:02.587107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:02.589097 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:02.596147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:02.597185 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.597993 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:02.598463 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.735465 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:02.744538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-07d7917f-7881-411c-856a-27ad97e3fd1a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.160962 Dec 09 01:15:02.745179 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 426/903] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:02 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:02.747059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:02.748066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:02.754159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:02.754656 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.755561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:02.756005 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:02.846817 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cf24d4c7-d3f5-4835-9eb5-83db33d3adc8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 32750 microversion: 2.1 time: 0.104208 Dec 09 01:15:02.847686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 478/904] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:02 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 32750 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:03.137455 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:03.137977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:03.144069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.144515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.145310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.145743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.272277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:03.280432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:03.281953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:03.283121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2a6525c7-b8f8-4b6e-bd1e-4cd5f0c6661e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.150179 Dec 09 01:15:03.283672 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 427/905] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:03 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:03.761562 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:03.762250 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:03.769111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.769556 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.770347 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.770800 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.859592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:03.860693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:03.866616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.867137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.867981 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:03.868487 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:03.914335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:03.922391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-27f9b922-f712-4ed1-b1db-7c834c2230ae tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1258 microversion: 2.1 time: 0.164822 Dec 09 01:15:03.923002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 479/906] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:03 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:03.970917 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1df9d96e-2d0e-47f3-99e1-72e1842e7fa8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 33418 microversion: 2.1 time: 0.116070 Dec 09 01:15:03.971558 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 428/907] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:03 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 33418 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:15:04.300782 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:04.301407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:04.307548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.307995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.308886 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.309318 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.436906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:04.445334 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:04.446973 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:04.448127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6382df61-f011-4bbe-98c5-fd06883cfa75 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.151002 Dec 09 01:15:04.449350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 480/908] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:04 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:04.536309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-c0decda8-92e4-4256-abea-570883311450 req-c07a1654-08be-4811-81f3-5bde426de765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "name": "network-vif-plugged", "status": "completed", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:04.537781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:04.537781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:15:04.545493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c0decda8-92e4-4256-abea-570883311450 req-c07a1654-08be-4811-81f3-5bde426de765 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.545943 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-c0decda8-92e4-4256-abea-570883311450 req-c07a1654-08be-4811-81f3-5bde426de765 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.556570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-c0decda8-92e4-4256-abea-570883311450 req-c07a1654-08be-4811-81f3-5bde426de765 service nova] Creating event network-vif-plugged:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:15:04.561864 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-c0decda8-92e4-4256-abea-570883311450 req-c07a1654-08be-4811-81f3-5bde426de765 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029544 Dec 09 01:15:04.562457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 429/909] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:04.938583 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:04.939210 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:04.945576 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.946045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.946878 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.947324 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.983331 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:04.984568 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:04.991336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.991893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:04.992765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:04.993218 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:05.085171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:05.092875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fec55373-6e44-4a48-95c1-6f8daa1c29c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 34547 microversion: 2.1 time: 0.113440 Dec 09 01:15:05.093667 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 430/910] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:04 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 34547 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:15:05.094461 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-18dfe1c6-5b4c-48da-b1c1-f621ac1f74c5 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1442 microversion: 2.1 time: 0.159652 Dec 09 01:15:05.095282 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 481/911] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:04 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:05.111080 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:05.111712 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:05.118553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:05.119013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:05.119805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:05.120243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:05.256085 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:05.264087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-99e2b90e-e1be-48e8-bf45-3615429b1227 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1442 microversion: 2.1 time: 0.157039 Dec 09 01:15:05.264657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 431/912] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:05 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:05.467382 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:05.468095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:05.474350 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:05.474834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:05.475617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:05.476051 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:05.608429 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:05.616863 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:05.618485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:05.619691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e9c124fb-985e-437a-8635-7d9bc3c67d87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.156377 Dec 09 01:15:05.620265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 482/913] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:05 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:15:06.105706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:06.106971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:06.113658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:06.114107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:06.114907 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:06.115343 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:06.262864 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-017ce6ba-5ff1-4cbd-923b-626e3475f4c4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 35636 microversion: 2.1 time: 0.161114 Dec 09 01:15:06.267101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 432/914] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:06 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 35636 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:06.638842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:06.639468 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:06.646021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:06.646512 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:06.647302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:06.647923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:06.791595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:06.801320 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:06.802861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:06.804026 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-00681bd7-b6a2-4ed9-9aa9-24832f4fbe0b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1808 microversion: 2.20 time: 0.169572 Dec 09 01:15:06.804599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 483/915] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:06 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:07.015229 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-247ac575-d6c1-45ed-82ba-c6e8c99b68ca req-333a4d77-0c57-4307-9120-ef734e6f0b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:07.016622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:07.016622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:15:07.024365 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-247ac575-d6c1-45ed-82ba-c6e8c99b68ca req-333a4d77-0c57-4307-9120-ef734e6f0b6d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:07.024781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-247ac575-d6c1-45ed-82ba-c6e8c99b68ca req-333a4d77-0c57-4307-9120-ef734e6f0b6d service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:07.036676 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-247ac575-d6c1-45ed-82ba-c6e8c99b68ca req-333a4d77-0c57-4307-9120-ef734e6f0b6d service nova] Creating event network-changed:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:15:07.041315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-247ac575-d6c1-45ed-82ba-c6e8c99b68ca req-333a4d77-0c57-4307-9120-ef734e6f0b6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031114 Dec 09 01:15:07.041914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 433/916] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:07.274773 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:07.276194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:07.282398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:07.282897 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:07.283704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:07.284237 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:07.396964 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-37746390-745e-47d2-be8d-ed6e818252c8 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 37057 microversion: 2.1 time: 0.125664 Dec 09 01:15:07.398351 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 484/917] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:07 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 37057 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:07.824357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:07.825070 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:07.831393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:07.831782 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:07.832576 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:07.833023 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:07.980309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:07.988769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:07.990246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:07.991431 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f167f14f-b072-4acd-aa8f-485b021e1d52 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1795 microversion: 2.20 time: 0.171797 Dec 09 01:15:07.991994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 434/918] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:07 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1795 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:08.409584 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:08.410637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:08.417624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:08.418158 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:08.418971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:08.419411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:08.516709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-11d474cc-618d-4761-a8b9-95ad5023bb3f tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 38176 microversion: 2.1 time: 0.110996 Dec 09 01:15:08.517561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 485/919] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:08 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 38176 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:09.529625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:09.530569 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:09.536873 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:09.537321 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:09.538146 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:09.538623 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:09.630286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-37d948da-93bc-44c6-8d2f-a35cb7dcc5fe tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 38176 microversion: 2.1 time: 0.104730 Dec 09 01:15:09.630971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 435/920] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:09 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 38176 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:15:10.641804 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:10.642835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:10.649587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:10.650030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:10.650826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:10.651261 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:10.758302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e3e61117-01c3-4d77-b9cc-428fe1e15e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 38176 microversion: 2.1 time: 0.120301 Dec 09 01:15:10.758965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 486/921] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:10 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 38176 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:15:11.771120 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:11.772105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:11.779504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:11.779958 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:11.780733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:11.781173 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:11.889581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-279ac505-0464-46ab-a72c-e75674db2e4c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action" status: 200 len: 38307 microversion: 2.1 time: 0.122304 Dec 09 01:15:11.890500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 436/922] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:15:11 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/action => generated 38307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:11.900835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:11.901442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:11.908450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:11.908898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:11.909677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:11.910113 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:11.934085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0a8e0c75-acf6-44b5-a0ec-f114af1743b6 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/ips" status: 200 len: 146 microversion: 2.1 time: 0.037195 Dec 09 01:15:11.934696 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 487/923] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:15:11 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:13.228833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35853dc7-c844-497e-a497-559ea3a2442d"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:13.230500 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:13.237261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:13.237712 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:13.238521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:13.238959 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:13.485851 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-926b35b5-2742-4fe9-96d2-903eec258120 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260710 Dec 09 01:15:13.486484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 437/924] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:15:13 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:20.942244 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:20.943187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:20.950620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:20.951090 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:20.951914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:20.952403 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:20.981766 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-43e7d64f-18c7-4bba-b7f1-183c71b2c5cd tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Dec 09 01:15:20.982311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 488/925] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:15:20 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:20.992288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:20.992875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:21.000076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:21.000532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:21.001319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:21.001764 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:21.029971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6910f005-ab17-4ef2-b67b-db7ebfaae1b1 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d" status: 200 len: 194 microversion: 2.1 time: 0.041766 Dec 09 01:15:21.030568 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 438/926] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Dec 9 01:15:20 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:22.328481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79508e1-3da7-4582-ab67-4c6173baff8a"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:22.329602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:22.335916 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:22.336380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:22.337418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:22.337864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:22.585815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d67b6e74-0f67-4715-ad1d-ed89d6ab39db tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261016 Dec 09 01:15:22.586466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 489/927] 10.222.0.23 () {60 vars in 1322 bytes} [Thu Dec 9 01:15:22 2021] POST /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:30.046920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:30.047878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:30.053684 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.054140 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.054962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.055402 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.084037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7398ca2c-8aa8-4c4a-acf1-0e003e358e16 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041978 Dec 09 01:15:30.084599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 439/928] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:15:30 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:30.286130 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:30.286729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:30.293521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.293981 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.294852 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.295295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.323224 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7e4f5c5b-fe7f-49a7-9d09-78cd960add31 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d" status: 200 len: 194 microversion: 2.1 time: 0.041756 Dec 09 01:15:30.323824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 490/929] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Dec 9 01:15:30 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:30.333209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:30.333708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:30.340798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.341252 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.342032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:30.342506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:30.419867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lazy-loading 'services' on Instance uuid dff79e04-c822-44bc-b9dd-2e0f3b412de7 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:15:30.487241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eef0533c-3226-4160-a195-f4053b9590e2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d" status: 202 len: 0 microversion: 2.1 time: 0.157598 Dec 09 01:15:30.487818 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 440/930] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:15:30 2021] DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/35853dc7-c844-497e-a497-559ea3a2442d => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:15:32.647308 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:32.647807 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:32.654733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:32.655184 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:32.655952 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:32.656384 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:32.684416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8bb5bff8-852a-4e47-a4f8-54d6588fbf08 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/f79508e1-3da7-4582-ab67-4c6173baff8a" status: 200 len: 194 microversion: 2.1 time: 0.040827 Dec 09 01:15:32.684989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 491/931] 10.222.0.23 () {58 vars in 1412 bytes} [Thu Dec 9 01:15:32 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/f79508e1-3da7-4582-ab67-4c6173baff8a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:32.695387 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:32.695962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:32.702327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:32.702822 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:32.703587 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:32.704048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:32.782735 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lazy-loading 'services' on Instance uuid dff79e04-c822-44bc-b9dd-2e0f3b412de7 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:15:32.849548 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2fa81ac5-2aa8-4ed8-8780-c660d19ae004 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/f79508e1-3da7-4582-ab67-4c6173baff8a" status: 202 len: 0 microversion: 2.1 time: 0.158595 Dec 09 01:15:32.850141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 441/932] 10.222.0.23 () {58 vars in 1415 bytes} [Thu Dec 9 01:15:32 2021] DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments/f79508e1-3da7-4582-ab67-4c6173baff8a => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:15:34.004716 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:34.005683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:34.011995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.012446 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.013222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.013655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.041612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2d407183-9206-427a-bd3d-361be132bec7 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040585 Dec 09 01:15:34.042857 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 492/933] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:15:33 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:15:34.141977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:34.142992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:34.148914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.149358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.150135 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.150598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.178640 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-52f60c21-a632-4376-9eed-a5e8e34d4c5e tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041149 Dec 09 01:15:34.179176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 442/934] 10.222.0.23 () {58 vars in 1301 bytes} [Thu Dec 9 01:15:34 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 09 01:15:34.235251 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:34.235685 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:34.241467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.241911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.242714 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.243147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.266977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:15:34.339636 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8d226492-6943-4e0a-8ec9-4bed3ab8bd43 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 204 len: 0 microversion: 2.1 time: 0.107346 Dec 09 01:15:34.340163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 493/935] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:15:34 2021] DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:15:34.347968 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:34.348579 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:34.354382 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.354878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.355651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:34.356086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:34.483529 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:34.490709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-574ba5c3-ab36-48f8-9472-361ce2d3ae26 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1674 microversion: 2.1 time: 0.146198 Dec 09 01:15:34.491209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 443/936] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:34 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:35.508119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:35.508814 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:35.515010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:35.515454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:35.516217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:35.516651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:35.653444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:35.660728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b500579c-b945-493f-8472-4366531aa6c2 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1674 microversion: 2.1 time: 0.156547 Dec 09 01:15:35.661292 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 494/937] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:35 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:36.678079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:36.678722 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:36.685338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:36.685820 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:36.686621 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:36.687764 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:36.819406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:36.826644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fb4b5970-3769-4d44-8e05-8cb83f0b38d0 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1674 microversion: 2.1 time: 0.152185 Dec 09 01:15:36.827215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 444/938] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:36 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:37.308080 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-01085f49-b5ed-4d82-9bf0-031b79d597fc req-bd2e910a-ecc7-4d78-83b2-c924f56804a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff79e04-c822-44bc-b9dd-2e0f3b412de7", "name": "network-vif-deleted", "tag": "ee3f3652-c539-4795-8d3f-0a54415c13a1"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:37.309688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:37.309688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:15:37.317432 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-01085f49-b5ed-4d82-9bf0-031b79d597fc req-bd2e910a-ecc7-4d78-83b2-c924f56804a6 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:37.317881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-01085f49-b5ed-4d82-9bf0-031b79d597fc req-bd2e910a-ecc7-4d78-83b2-c924f56804a6 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:37.329270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-01085f49-b5ed-4d82-9bf0-031b79d597fc req-bd2e910a-ecc7-4d78-83b2-c924f56804a6 service nova] Creating event network-vif-deleted:ee3f3652-c539-4795-8d3f-0a54415c13a1 for instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 on hv-cinder-79053 Dec 09 01:15:37.334093 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-01085f49-b5ed-4d82-9bf0-031b79d597fc req-bd2e910a-ecc7-4d78-83b2-c924f56804a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 Dec 09 01:15:37.335317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 495/939] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:37.845963 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:37.848928 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:37.855469 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:37.855920 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:37.856707 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:37.857157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:37.889627 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:37.890110 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:37.890605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lazy-loading 'fault' on Instance uuid dff79e04-c822-44bc-b9dd-2e0f3b412de7 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:15:37.932345 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62defd8645f7454699ee5c7bb5930d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a8a131b9d4f239bc6b9dc03642f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:37.940678 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-60e4fa12-b853-4e38-bcd4-926ffd68612c tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 200 len: 1328 microversion: 2.1 time: 0.100639 Dec 09 01:15:37.941312 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 445/940] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:37 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:38.959453 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:38.960165 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:38.966691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:38.967148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:38.967927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:38.968616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:38.981442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. Dec 09 01:15:38.982022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:38.982853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-26ee1704-c8a0-4f32-a234-03a4c6206c2a tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 404 len: 111 microversion: 2.1 time: 0.028127 Dec 09 01:15:38.983376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 496/941] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:38 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:38.991406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-96bd400e-a5f2-4e1b-b06a-1d7cf3e6a199 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '.version_select at 0x7fe619dccaf0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:39.008502 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-96bd400e-a5f2-4e1b-b06a-1d7cf3e6a199 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564591808" status: 202 len: 0 microversion: 2.1 time: 0.020674 Dec 09 01:15:39.009069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 446/942] 10.222.0.23 () {58 vars in 1220 bytes} [Thu Dec 9 01:15:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564591808 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:15:41.196035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:41.196619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:41.203306 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.203765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.204548 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.204988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.233391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e101f86f-6ccf-4bba-84af-fa4e48a95307 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments/72515415-726b-4c3e-8d10-23dc79600813" status: 200 len: 194 microversion: 2.20 time: 0.041335 Dec 09 01:15:41.234890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 497/943] 10.222.0.23 () {60 vars in 1453 bytes} [Thu Dec 9 01:15:41 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments/72515415-726b-4c3e-8d10-23dc79600813 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:41.304236 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:41.304743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:41.311451 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.312125 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.312944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.313392 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.389596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lazy-loading 'services' on Instance uuid 1515b060-5e76-4152-acbc-e3affaca18e2 {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:15:41.455947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2855b7ee-2013-4600-8cd1-29843ad140af tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments/72515415-726b-4c3e-8d10-23dc79600813" status: 202 len: 0 microversion: 2.20 time: 0.155903 Dec 09 01:15:41.456528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 447/944] 10.222.0.23 () {60 vars in 1456 bytes} [Thu Dec 9 01:15:41 2021] DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments/72515415-726b-4c3e-8d10-23dc79600813 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:15:41.464907 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:41.465906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:41.472339 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.472784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.473561 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.473999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.504195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-763245f9-fd7f-44f0-80fe-8216340d06d6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043217 Dec 09 01:15:41.504759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 498/945] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Dec 9 01:15:41 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:15:41.862411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:41.862997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:41.868960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.869412 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.870191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.870664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.883717 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. Dec 09 01:15:41.884296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:41.885094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-819e91d5-4823-42ed-be91-aa523059d8da tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 404 len: 111 microversion: 2.1 time: 0.026842 Dec 09 01:15:41.885602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 448/946] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:15:41 2021] DELETE /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:41.893627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:41.894240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: dff79e04-c822-44bc-b9dd-2e0f3b412de7] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:41.900259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.900710 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.901492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:41.901932 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:41.920901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. Dec 09 01:15:41.921804 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance dff79e04-c822-44bc-b9dd-2e0f3b412de7 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:41.923345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1514ce35-2f8d-45fb-8aeb-a6ba1ce5d972 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7" status: 404 len: 111 microversion: 2.1 time: 0.033179 Dec 09 01:15:41.923892 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 499/947] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:41 2021] GET /compute/v2.1/servers/dff79e04-c822-44bc-b9dd-2e0f3b412de7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:42.515960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:42.516904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:42.523114 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.523572 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.524349 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.524791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.553389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e193b3bb-52c7-4c6c-956b-3c4d746b2315 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041515 Dec 09 01:15:42.553939 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 449/948] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Dec 9 01:15:42 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:15:42.607868 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:42.608376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:42.615127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.615581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.616364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.616804 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.641833 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:15:42.714740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-303034c0-c966-4444-af9b-249853374d2e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 204 len: 0 microversion: 2.20 time: 0.109814 Dec 09 01:15:42.715274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 500/949] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Dec 9 01:15:42 2021] DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 09 01:15:42.724878 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:42.725482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:42.731331 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.731785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.732566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:42.733004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:42.865426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:42.873068 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:42.874720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:42.875849 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a4e1182c-c5f1-44b2-9fd1-f8be550c875a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.154658 Dec 09 01:15:42.876397 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 450/950] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:42 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:43.051750 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:43.052327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:43.058010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.058497 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:43.059274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.059709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:43.072323 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. Dec 09 01:15:43.072891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:43.073679 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9fc99f1b-22e1-4922-aa30-eaa2ee35cea4 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 404 len: 111 microversion: 2.1 time: 0.025936 Dec 09 01:15:43.074217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 501/951] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:15:43 2021] DELETE /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:43.082556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:43.083168 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] [instance: b11e7d82-d6f0-4625-980e-40d38e06de06] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:43.089369 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.089823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:43.090627 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.091070 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:43.104688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] HTTP exception thrown: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. Dec 09 01:15:43.105260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] Returning 404 to user: Instance b11e7d82-d6f0-4625-980e-40d38e06de06 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:43.106079 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-79930e8a-bb3f-4896-9c9b-5970363fe236 tempest-AttachVolumeTestJSON-1424586768 tempest-AttachVolumeTestJSON-1424586768-project] 10.222.0.23 "GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06" status: 404 len: 111 microversion: 2.1 time: 0.027190 Dec 09 01:15:43.106632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 451/952] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:15:43 2021] GET /compute/v2.1/servers/b11e7d82-d6f0-4625-980e-40d38e06de06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:15:43.894314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:43.894971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:43.901248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.901693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:43.902516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:43.902954 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:44.035946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:44.043849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:44.045326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:44.047061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2c996f33-775f-46be-b280-c50d73761b24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.156749 Dec 09 01:15:44.047618 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 502/953] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:43 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:45.065670 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:45.066322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:45.072581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:45.073069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:45.073856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:45.074295 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:45.325058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:45.337176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:45.339403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:45.340838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eaf68876-287b-415a-ad5c-22fdda586796 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 200 len: 1723 microversion: 2.20 time: 0.279724 Dec 09 01:15:45.354101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 452/954] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:45 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:45.721662 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-2f04db0e-974e-4860-b72c-529e3c79a19e req-fba3bb97-36f4-457f-9096-a248d0bf801c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515b060-5e76-4152-acbc-e3affaca18e2", "name": "network-vif-deleted", "tag": "32dbcbce-dad9-41fe-b5d3-02be9f909db4"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:45.724246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:45.724246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:15:45.732370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-2f04db0e-974e-4860-b72c-529e3c79a19e req-fba3bb97-36f4-457f-9096-a248d0bf801c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:45.733095 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-2f04db0e-974e-4860-b72c-529e3c79a19e req-fba3bb97-36f4-457f-9096-a248d0bf801c service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:45.750881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-2f04db0e-974e-4860-b72c-529e3c79a19e req-fba3bb97-36f4-457f-9096-a248d0bf801c service nova] Creating event network-vif-deleted:32dbcbce-dad9-41fe-b5d3-02be9f909db4 for instance 1515b060-5e76-4152-acbc-e3affaca18e2 on hv-cinder-79053 Dec 09 01:15:45.756837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-2f04db0e-974e-4860-b72c-529e3c79a19e req-fba3bb97-36f4-457f-9096-a248d0bf801c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039848 Dec 09 01:15:45.759325 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 503/955] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:46.360687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:46.361393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:46.372385 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:46.373057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:46.374988 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:46.375977 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:46.392960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. Dec 09 01:15:46.393842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:15:46.394709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fc1de7a4-4aa0-4f82-826a-aace75e0d6ac tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 404 len: 111 microversion: 2.20 time: 0.038938 Dec 09 01:15:46.395256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 453/956] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:46 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 09 01:15:46.404162 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ec7c6f89-e4e3-4d17-a980-ad3d2c5e4d8e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '.version_select at 0x7fe619e1d310>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:46.425882 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ec7c6f89-e4e3-4d17-a980-ad3d2c5e4d8e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-532470873" status: 204 len: 0 microversion: 2.20 time: 0.025654 Dec 09 01:15:46.426864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 504/957] 10.222.0.23 () {60 vars in 1258 bytes} [Thu Dec 9 01:15:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-532470873 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 09 01:15:47.365231 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: .version_select at 0x7fe619d5fdc0>, body: {"keypair": {"name": "tempest-keypair-1175306158"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:47.384624 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:15:47.388360 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:15:47.706914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:15:47.714192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'key_pairs'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:15:47.727669 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c17f264b-2cfc-4570-9998-010f33252514 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.366162 Dec 09 01:15:47.728536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 454/958] 10.222.0.23 () {62 vars in 1198 bytes} [Thu Dec 9 01:15:47 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 368 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 09 01:15:49.079929 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1356291761", "imageRef": "0511ba06-d2e5-4de8-8eeb-28861c34e737", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccbffc9b-fb85-4600-abf1-45c776b606b2"}], "security_groups": [{"name": "tempest-securitygroup--1620366543"}], "key_name": "tempest-keypair-1175306158", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:49.191391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] validate_networks() for [('ccbffc9b-fb85-4600-abf1-45c776b606b2', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:15:49.572074 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:15:49.572496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:15:49.572968 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:15:49.573376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:15:49.573818 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:15:49.583760 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:49.584217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:49.585021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:49.585457 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:49.601890 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for project e237e82cdcf24c93b91e0c1799f78928. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:15:49.606798 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Getting quotas for user e10d73a08d6e43e79df2c2e1d3161b7e and project e237e82cdcf24c93b91e0c1799f78928. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:15:49.618892 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:15:49.621311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0511ba06-d2e5-4de8-8eeb-28861c34e737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:15:49.674299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c9c6f636-6b56-4991-ab53-f259352e7efa tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.598986 Dec 09 01:15:49.675015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 505/959] 10.222.0.23 () {62 vars in 1187 bytes} [Thu Dec 9 01:15:49 2021] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 09 01:15:49.684921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:49.685570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:49.744401 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:49.752931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:49.754445 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:49.755533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-2d579f0d-3f23-4a03-90aa-4284b721220a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1282 microversion: 2.20 time: 0.074625 Dec 09 01:15:49.756119 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 455/960] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:49 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:50.776183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:50.776816 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:50.786586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:50.787043 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:50.787889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:50.788393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:50.861624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:50.870098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:50.871757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:50.872957 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a4c1f2a7-e526-4c92-98b8-fc443e577d27 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1340 microversion: 2.20 time: 0.102198 Dec 09 01:15:50.873637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 506/961] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:50 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:51.892339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:51.892964 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:51.898942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:51.899396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:51.900194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:51.900636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:52.065386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:52.075243 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:52.076616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:52.078303 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b3992b73-b1e6-47b2-9741-d718dd197226 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.190495 Dec 09 01:15:52.078885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 456/962] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:51 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:15:52.295743 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-ed466934-37ff-4243-97b1-adc70812c9b5 req-0b290fbe-bfd2-45ec-a1fa-db5d07ec2587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:52.301408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:52.301408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:15:52.320072 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-ed466934-37ff-4243-97b1-adc70812c9b5 req-0b290fbe-bfd2-45ec-a1fa-db5d07ec2587 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:52.320549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-ed466934-37ff-4243-97b1-adc70812c9b5 req-0b290fbe-bfd2-45ec-a1fa-db5d07ec2587 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:52.335103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-ed466934-37ff-4243-97b1-adc70812c9b5 req-0b290fbe-bfd2-45ec-a1fa-db5d07ec2587 service nova] Creating event network-changed:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:15:52.340977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-ed466934-37ff-4243-97b1-adc70812c9b5 req-0b290fbe-bfd2-45ec-a1fa-db5d07ec2587 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060713 Dec 09 01:15:52.341970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 507/963] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:53.096962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:53.097565 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:53.103823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:53.104269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:53.105043 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:53.105479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:53.248425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:53.257942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:53.259617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:53.261028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7b47c1f4-784c-44d4-bd2e-5d693db20fdb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.167783 Dec 09 01:15:53.273405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 457/964] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:53 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:54.279511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:54.280469 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:54.286955 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:54.287404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:54.288178 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:54.289608 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:54.491183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:54.502914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:54.504179 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:54.505655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-74eafa30-cfa5-4ea0-8314-ef34dec6571c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.230188 Dec 09 01:15:54.506204 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 508/965] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:54 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:55.523965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:55.524679 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:55.531574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:55.532037 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:55.532895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:55.533338 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:55.667064 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:55.675038 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:55.676608 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:55.677781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-011f1ffc-f775-465a-a01d-579302b71a98 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.157438 Dec 09 01:15:55.678448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 458/966] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:55 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:56.649103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-be917415-5c32-4309-9275-ea3a3bdf3814 req-77d47afa-957e-4bc9-be17-784621a6bfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "name": "network-vif-plugged", "status": "completed", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:15:56.651203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:15:56.651203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:15:56.659199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-be917415-5c32-4309-9275-ea3a3bdf3814 req-77d47afa-957e-4bc9-be17-784621a6bfba service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:56.659844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-be917415-5c32-4309-9275-ea3a3bdf3814 req-77d47afa-957e-4bc9-be17-784621a6bfba service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:56.671335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-be917415-5c32-4309-9275-ea3a3bdf3814 req-77d47afa-957e-4bc9-be17-784621a6bfba service nova] Creating event network-vif-plugged:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:15:56.677930 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-be917415-5c32-4309-9275-ea3a3bdf3814 req-77d47afa-957e-4bc9-be17-784621a6bfba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032661 Dec 09 01:15:56.679270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 509/967] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:15:56.699362 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:56.699362 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:56.706426 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:56.706980 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:56.707858 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:56.708375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:56.860851 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:56.869244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:56.871044 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:56.872235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-255341a9-1cbb-4861-8aa7-c58a1ff35644 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.179285 Dec 09 01:15:56.872870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 459/968] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:56 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:57.891421 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:57.892128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:57.898227 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:57.898708 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:57.899495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:57.899938 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:58.045224 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:58.053822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:58.055240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:58.056349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f706d37a-70aa-4170-ad11-1442173941ed tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1408 microversion: 2.20 time: 0.170255 Dec 09 01:15:58.057187 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 510/969] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:57 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:59.073768 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:59.074391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:59.080817 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:59.081270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:59.082123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:59.082504 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:59.221503 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:59.229578 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:59.231208 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:15:59.232409 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cc6bff3b-b620-4d9f-9139-0ad548e7ac58 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1599 microversion: 2.20 time: 0.162280 Dec 09 01:15:59.232964 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 460/970] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:15:59 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:15:59.249794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:15:59.250277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:15:59.257035 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:59.257482 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:59.258260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:15:59.258720 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:15:59.339573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a27d4690-7b7a-4f52-bd4d-d50ed5b8437b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093529 Dec 09 01:15:59.340500 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 511/971] 10.222.0.23 () {60 vars in 1315 bytes} [Thu Dec 9 01:15:59 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:16:00.330358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:00.331501 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:00.333225 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-4abfb7e1-06ff-4c08-8017-101cfc447b0a req-10c70149-a14e-492e-bb59-037b894dfbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:00.335248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:16:00.335248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:16:00.339069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:00.339637 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:00.340521 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:00.341058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:00.342344 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-4abfb7e1-06ff-4c08-8017-101cfc447b0a req-10c70149-a14e-492e-bb59-037b894dfbb7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:00.342881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-4abfb7e1-06ff-4c08-8017-101cfc447b0a req-10c70149-a14e-492e-bb59-037b894dfbb7 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:00.356444 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-4abfb7e1-06ff-4c08-8017-101cfc447b0a req-10c70149-a14e-492e-bb59-037b894dfbb7 service nova] Creating event network-changed:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:16:00.362152 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-4abfb7e1-06ff-4c08-8017-101cfc447b0a req-10c70149-a14e-492e-bb59-037b894dfbb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033324 Dec 09 01:16:00.363288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 512/972] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:16:00.442994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-146ce219-d5a3-4f24-a834-0cd72d93c47b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.116597 Dec 09 01:16:00.443826 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 461/973] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:00 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:01.455297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:01.456296 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:01.462599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:01.463061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:01.463837 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:01.464280 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:01.544926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-363bebf9-1571-4e1d-a672-aba07fac381a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.094212 Dec 09 01:16:01.545640 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 513/974] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:01 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:02.556261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:02.558447 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:02.565378 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:02.565822 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:02.566625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:02.567056 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:02.654604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-38d318da-c1ce-48e5-8a14-8748072a3efb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.102134 Dec 09 01:16:02.655979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 462/975] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:02 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:03.665333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:03.666319 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:03.673391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:03.673834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:03.674628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:03.675063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:03.755222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9dae4203-2117-4f1b-baa5-649cb1838fd0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.093690 Dec 09 01:16:03.758348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 514/976] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:03 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:04.765954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:04.767872 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:04.774269 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:04.774750 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:04.775524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:04.775955 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:04.857122 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8cd8dfc0-0a8c-4ae8-86f9-9a3f9d43868f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.094989 Dec 09 01:16:04.857942 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 463/977] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:04 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:05.868354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:05.869393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:05.876885 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:05.877277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:05.878056 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:05.878529 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:05.958185 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-14688229-78a1-4aaf-aef0-b790b041c5f4 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.093687 Dec 09 01:16:05.958867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 515/978] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:05 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:06.969331 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:06.970856 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:06.977727 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:06.978184 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:06.978996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:06.979444 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:07.062831 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8a7120df-cf0b-4e49-8672-2822839c1e54 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.097305 Dec 09 01:16:07.063904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 464/979] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:06 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:08.073485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:08.074655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:08.082022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:08.082515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:08.083299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:08.083740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:08.182648 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5b1398d2-ba87-43a5-9baf-a30539ba0bbc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.112955 Dec 09 01:16:08.183180 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 516/980] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:08 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:09.194094 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:09.195167 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:09.202042 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:09.202564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:09.203340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:09.203833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:09.288438 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-e7d45cb1-2db1-4f76-8436-d390b0665039 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 14 microversion: 2.20 time: 0.098160 Dec 09 01:16:09.289062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 465/981] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:09 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:10.300134 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:10.301240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:10.308022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:10.308505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:10.309291 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:10.309728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:10.402387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d595922d-4146-4153-90a4-d7c69e672ec3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 11050 microversion: 2.20 time: 0.106601 Dec 09 01:16:10.403828 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 517/982] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:10 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 11050 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:11.413922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:11.415591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:11.422671 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:11.423601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:11.424612 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:11.425258 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:11.519620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9323fea4-4907-4075-b0f7-7654363291d5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 18608 microversion: 2.20 time: 0.109533 Dec 09 01:16:11.520990 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 466/983] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:11 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 18608 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:12.533317 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:12.535255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:12.542850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:12.543281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:12.544108 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:12.544579 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:12.642680 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-039c64f3-fe1b-4f6c-825b-84c36d640c46 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 19342 microversion: 2.20 time: 0.111468 Dec 09 01:16:12.648119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 518/984] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:12 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 19342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:13.654413 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:13.656225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:13.664781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:13.666650 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:13.667817 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:13.668416 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:13.759479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-713df436-ac7a-4bfd-86d3-e28d0fa91c14 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 21972 microversion: 2.20 time: 0.108879 Dec 09 01:16:13.763875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 467/985] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:13 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 21972 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:14.773085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:14.774163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:14.784284 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:14.784826 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:14.785695 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:14.786215 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:14.882551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d10d49c5-3c10-4aa9-8f16-001f98ac5029 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 23235 microversion: 2.20 time: 0.113850 Dec 09 01:16:14.884080 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 519/986] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:14 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 23235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:15.894928 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:15.895964 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:15.902906 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:15.903361 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:15.904162 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:15.904605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:15.996285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-07e037dc-ab48-4a40-8213-c6a1d0775a66 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 24996 microversion: 2.20 time: 0.105679 Dec 09 01:16:15.997248 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 468/987] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:15 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 24996 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:17.014850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:17.017623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:17.027891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:17.028866 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:17.029877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:17.031128 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:17.150530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a76eea4d-5721-4dae-b7f2-4b4d0c8d8d8a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 26621 microversion: 2.20 time: 0.141288 Dec 09 01:16:17.151189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 520/988] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:17 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 26621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:18.170945 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:18.171968 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:18.185104 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:18.185577 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:18.186412 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:18.186866 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:18.651188 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5e52bf3c-e188-43e8-a57c-b1c2108715b2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 27836 microversion: 2.20 time: 0.486221 Dec 09 01:16:18.659443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 469/989] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:18 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 27836 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:19.667230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:19.668336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:19.676336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:19.677025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:19.678039 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:19.678629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:19.762933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Action: 'create', calling method: .version_select at 0x7fe619e64940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-503582836"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:19.779916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fbc7c131-4684-4fe6-980c-bcd6213f95d1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28206 microversion: 2.20 time: 0.117213 Dec 09 01:16:19.780547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 470/990] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:19 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28206 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:16:19.787413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for project 7480e21bc2664d4e94526980995f0f6c. Resources: {'key_pairs'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:16:19.791441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for user 145783b498ca431aab3f9fe0c958e60a and project 7480e21bc2664d4e94526980995f0f6c. Resources: {'key_pairs'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:16:19.933752 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for project 7480e21bc2664d4e94526980995f0f6c. Resources: {'key_pairs'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:16:19.937368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for user 145783b498ca431aab3f9fe0c958e60a and project 7480e21bc2664d4e94526980995f0f6c. Resources: {'key_pairs'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:16:19.951668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c16dd399-a08c-4b71-965c-7467d677613b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.364200 Dec 09 01:16:19.952270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 521/991] 10.222.0.23 () {60 vars in 1157 bytes} [Thu Dec 9 01:16:19 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:20.792539 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:20.794163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:20.812315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:20.813538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:20.815237 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:20.815954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:20.912953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-153f4d6c-a5f2-4c83-b130-5bd3d810ab87 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28206 microversion: 2.20 time: 0.124371 Dec 09 01:16:20.913674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 471/992] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:20 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28206 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:21.925498 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:21.926536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:21.933507 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:21.933959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:21.934815 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:21.935255 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:22.036669 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-798219c6-c7c5-4c8f-a2a7-24459d2e8385 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28496 microversion: 2.20 time: 0.115477 Dec 09 01:16:22.037321 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 522/993] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:21 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28496 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:23.048995 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:23.049987 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:23.056825 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:23.057279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:23.058058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:23.058533 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:23.163467 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-eead4b0f-82fb-4d8c-b464-aaa3e847a9ae tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28664 microversion: 2.20 time: 0.118361 Dec 09 01:16:23.167469 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 472/994] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:23 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28664 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:24.177565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:24.178621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:24.185554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:24.186008 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:24.186824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:24.187272 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:24.272939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e9a8ba1d-f0db-4dd1-a1fc-200797a96105 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28664 microversion: 2.20 time: 0.100651 Dec 09 01:16:24.273651 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 523/995] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:24 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28664 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:25.285796 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:25.286812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:25.293824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:25.294272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:25.295087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:25.295525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:25.387872 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b31653ad-3ee8-4414-8cc3-ee927f956865 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28664 microversion: 2.20 time: 0.106269 Dec 09 01:16:25.388523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 473/996] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:25 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28664 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:16:26.400416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:26.401409 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:26.408738 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:26.409122 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:26.409891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:26.410326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:26.513940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-49157598-49dc-4c80-bfc8-a5c9d0bbf383 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 28783 microversion: 2.20 time: 0.117326 Dec 09 01:16:26.514621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 524/997] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:26 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 28783 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:27.527974 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:27.529536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:27.539666 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:27.540819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:27.541905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:27.542707 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:27.658741 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fb024340-145f-4a16-99a5-c3144287771b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 30732 microversion: 2.20 time: 0.134820 Dec 09 01:16:27.659414 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 474/998] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:27 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 30732 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:28.670933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:28.671985 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:28.678799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:28.679256 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:28.680033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:28.680474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:28.785632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c11dabe5-b330-4bb7-842f-b79089373e7a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 32090 microversion: 2.20 time: 0.118553 Dec 09 01:16:28.786293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 525/999] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:28 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 32090 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:29.798319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:29.799493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:29.806471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:29.806926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:29.807721 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:29.808163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:29.909562 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-311d46d2-d0f1-4e3a-b1c3-98b7809dbb82 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 33115 microversion: 2.20 time: 0.115740 Dec 09 01:16:29.910133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 475/1000] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:29 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 33115 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:16:30.921729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:30.922668 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:30.932806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:30.933526 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:30.934796 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:30.935534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:31.193049 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9db8dfed-6fa8-4876-b06b-38756bd14c81 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 34249 microversion: 2.20 time: 0.275139 Dec 09 01:16:31.193616 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 526/1001] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:30 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 34249 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:32.205916 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:32.206960 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:32.214000 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:32.214480 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:32.215255 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:32.215685 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:32.309687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-da404f3b-e585-4b41-ace5-df90068bba00 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 35526 microversion: 2.20 time: 0.108140 Dec 09 01:16:32.310559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 476/1002] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:32 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 35526 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:33.324248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:33.325242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:33.332619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:33.333066 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:33.333831 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:33.334326 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:33.428818 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9e993b30-2ab8-4ca1-a149-cee612069914 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 36795 microversion: 2.20 time: 0.108613 Dec 09 01:16:33.429455 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 527/1003] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:33 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 36795 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:34.441971 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:34.443024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:34.449824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:34.450275 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:34.451078 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:34.451518 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:34.559335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-45678922-c121-438f-9b9a-0de11421efcf tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 38087 microversion: 2.20 time: 0.121769 Dec 09 01:16:34.560340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 477/1004] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:34 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 38087 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:35.572417 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:35.573404 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:35.580242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:35.580694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:35.581471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:35.581936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:35.669871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-163c4478-3896-47ce-ad92-29ea5c63b4cd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 38214 microversion: 2.20 time: 0.101325 Dec 09 01:16:35.670509 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 528/1005] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:35 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 38214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:36.682709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:36.683743 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:36.691106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:36.691564 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:36.692366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:36.692806 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:36.774740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cfd45383-959f-4b25-ad84-c7646f43e5b3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 38214 microversion: 2.20 time: 0.095951 Dec 09 01:16:36.775636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 478/1006] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:36 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 38214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:16:37.170803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-977905040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503582836", "security_groups": [{"name": "tempest-secgroup-smoke-828630830"}], "block_device_mapping_v2": [{"uuid": "3741013f-8554-4c1b-a0fb-19fd6c28671d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7903c83a-1491-4cdb-8fa8-969596d0e034"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:37.291788 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] validate_networks() for [('7903c83a-1491-4cdb-8fa8-969596d0e034', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:16:37.669783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:16:37.670413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:16:37.670895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:16:37.671458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:16:37.672139 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:16:37.680702 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:37.681151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:37.681950 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:37.682405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:37.699397 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:16:37.704209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for user 145783b498ca431aab3f9fe0c958e60a and project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:16:37.758025 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:16:37.760292 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3741013f-8554-4c1b-a0fb-19fd6c28671d',volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:16:37.788264 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:37.789318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:37.796108 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:37.797644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:37.798490 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:37.798961 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:37.892874 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3785ae2f-2b72-4fe1-a5df-1f36c1033f08 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 38219 microversion: 2.20 time: 0.108423 Dec 09 01:16:37.893801 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 479/1007] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:37 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 38219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 09 01:16:37.908720 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-1b949f7e-31fd-49b1-b426-0b9db23e2fc5 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.741758 Dec 09 01:16:37.909391 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 529/1008] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:16:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:16:37.919791 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b9b8f9fa-f662-4ffa-9e88-6d5cba671975 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:37.920493 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b9b8f9fa-f662-4ffa-9e88-6d5cba671975 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:37.992482 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b9b8f9fa-f662-4ffa-9e88-6d5cba671975 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:38.000322 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b9b8f9fa-f662-4ffa-9e88-6d5cba671975 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1093 microversion: 2.1 time: 0.083911 Dec 09 01:16:38.000889 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 480/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:37 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:16:38.906303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:38.907278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:38.914322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:38.914811 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:38.915612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:38.916072 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:39.016411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9a1418d6-3273-41f7-902c-e86f74e919c8 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 200 len: 38357 microversion: 2.20 time: 0.114193 Dec 09 01:16:39.017459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 530/1010] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:38 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 38357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:16:39.021765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:39.022443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:39.027765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:39.028345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:39.029348 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:39.029809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:39.030697 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:39.031380 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:39.036936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:39.036936 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:39.037302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:39.037611 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:39.064473 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a181012b-823c-4e7b-b135-38d61d4bf46d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/ips" status: 200 len: 150 microversion: 2.20 time: 0.040639 Dec 09 01:16:39.070303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 531/1011] 10.222.0.23 () {60 vars in 1288 bytes} [Thu Dec 9 01:16:39 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 09 01:16:39.116260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:39.123706 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c3bde57f-18f8-4920-b9f5-b103a474a04b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1209 microversion: 2.1 time: 0.108323 Dec 09 01:16:39.135285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 481/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:39 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:40.144515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:40.145812 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:40.152693 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:40.153523 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:40.154569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:40.155033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:40.301891 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:40.310270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-52b29a18-21e2-4fbf-abf2-e4adffa037af tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.171108 Dec 09 01:16:40.310907 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 532/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:40 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:40.373266 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-922f3970-76a3-476f-8a72-db517ccfa4ed req-2d5d3837-edea-4938-9175-ad40cdd99930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e98f0f-f551-454d-83dc-72ea335bfab1", "tag": "5457fda6-471c-4e1e-af4a-0d995f51f52f"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:40.375495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:16:40.375495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:16:40.394330 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-922f3970-76a3-476f-8a72-db517ccfa4ed req-2d5d3837-edea-4938-9175-ad40cdd99930 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:40.395032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-922f3970-76a3-476f-8a72-db517ccfa4ed req-2d5d3837-edea-4938-9175-ad40cdd99930 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:40.409785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-922f3970-76a3-476f-8a72-db517ccfa4ed req-2d5d3837-edea-4938-9175-ad40cdd99930 service nova] Creating event network-changed:5457fda6-471c-4e1e-af4a-0d995f51f52f for instance a5e98f0f-f551-454d-83dc-72ea335bfab1 on hv-cinder-79053 Dec 09 01:16:40.417523 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-922f3970-76a3-476f-8a72-db517ccfa4ed req-2d5d3837-edea-4938-9175-ad40cdd99930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048346 Dec 09 01:16:40.418675 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 482/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:16:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:16:41.329109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:41.329728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:41.336522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.336931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.337729 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.338232 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.352197 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:41.352828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:41.359477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.360198 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.361004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.361448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.385901 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lazy-loading 'flavor' on Instance uuid e2406c5f-f317-423f-a675-5c32962ef6fb {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:16:41.513712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:41.522147 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c59204e0-51fa-4da7-8e1f-6c4710c1eacc tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.197468 Dec 09 01:16:41.522749 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 533/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:41 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:41.662664 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5aedee57-f04f-4654-86fe-204e021f38f3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 202 len: 0 microversion: 2.20 time: 0.314749 Dec 09 01:16:41.663505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 483/1016] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:16:41 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 09 01:16:41.671703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:41.672558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:41.679164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.679627 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.680414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:41.680862 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:41.814821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:41.822533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:41.824012 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:41.825159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-bf51635d-67e8-4f94-8058-5d69849fdd24 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.157489 Dec 09 01:16:41.825711 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 534/1017] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:41 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:42.540957 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:42.541662 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:42.549247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:42.549787 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:42.550768 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:42.551309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:42.689484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:42.698182 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-429c441d-6af4-4f00-be7c-429f2a568e28 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.162136 Dec 09 01:16:42.698932 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 484/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:42 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:16:42.845031 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:42.845803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:42.854914 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:42.855370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:42.856302 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:42.856742 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:43.009246 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:43.017732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:43.019258 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:43.020415 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0a12cc11-be47-4711-9856-cd98a0a35ac3 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.179810 Dec 09 01:16:43.020982 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 535/1019] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:42 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:43.715086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:43.715694 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:43.722807 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:43.723356 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:43.724256 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:43.724769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:43.866844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:43.874993 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3e816183-a950-4fb9-b39e-cf59d58b3507 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.162873 Dec 09 01:16:43.875859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 485/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:43 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:44.038829 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:44.039441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:44.045715 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:44.046848 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:44.047634 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:44.048072 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:44.182961 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:44.190797 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:44.192303 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:44.193445 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9e555b00-4f73-4a92-bb26-5adf78cb07cb tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.158376 Dec 09 01:16:44.193999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 536/1021] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:44 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:16:44.892495 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:44.893121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:44.899496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:44.899952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:44.900725 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:44.901213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:45.034825 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:45.042436 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a96a6b32-eddc-45e1-abb5-4f4ee73a7f41 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.154345 Dec 09 01:16:45.043003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 486/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:44 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:45.211772 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:45.212398 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:45.218939 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:45.219399 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:45.220218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:45.220666 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:45.353262 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:45.362054 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:45.363642 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:45.364753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-32049ee7-c3de-4abb-bd8b-8d0d8b729c07 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.157063 Dec 09 01:16:45.365315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 537/1023] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:45 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:46.059209 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:46.059815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:46.070017 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:46.070905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:46.071944 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:46.072394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:46.244374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:46.252032 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ab958aba-03a5-4783-8a99-a3b1b17abdf9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.196440 Dec 09 01:16:46.252610 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 487/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:46 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:46.383522 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:46.384544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:46.392998 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:46.393471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:46.394461 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:46.395020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:46.535243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:46.543856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:46.546245 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:46.547768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8d6dcd74-d3b2-4b2b-87d1-e18447c7b611 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.168413 Dec 09 01:16:46.549233 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 538/1025] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:46 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:47.270506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:47.271087 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:47.277542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:47.277996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:47.278845 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:47.279293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:47.437820 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:47.445073 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ea5fb75c-897b-4ac4-972c-3b1adda1d878 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.179970 Dec 09 01:16:47.445630 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 488/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:47 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:16:47.569554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:47.570492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:47.579740 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:47.580243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:47.581062 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:47.581511 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:47.724132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:47.731901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:47.733953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:47.735790 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d4a75a96-a370-4c89-b6be-5dd146ee55f5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.171031 Dec 09 01:16:47.736357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 539/1027] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:47 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:48.463524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:48.464137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:48.479823 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:48.480280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:48.481691 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:48.482133 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:48.756100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:48.756922 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:48.765438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:48.766150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:48.767090 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:48.767664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:48.883469 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:48.892026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3f16a138-5ba3-41ac-a36e-1412f8f3ce7c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.432397 Dec 09 01:16:48.892599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 489/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:48 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:48.967520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:48.976405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:48.977888 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:48.979073 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d35c1dc1-b353-4e4c-aded-cac83c143131 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.228737 Dec 09 01:16:48.979628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 540/1029] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:48 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:49.908424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:49.909121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:49.915404 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:49.915854 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:49.916653 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:49.917090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:49.998301 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:50.000276 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:50.007111 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:50.007594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:50.008481 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:50.008924 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:50.062169 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:50.069772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8fcec815-6740-43ee-828a-ebff52abbedf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.165405 Dec 09 01:16:50.070341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 490/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:49 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:50.155664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:50.163589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:50.165067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:50.166213 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e436bd67-62ea-4b14-b439-d246e7143717 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.171694 Dec 09 01:16:50.166806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 541/1031] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:49 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:50.772859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-70ba4d16-0509-462c-9e71-33ac495d8194 req-9c08d7b2-0863-44fc-8cd5-26acf3dbe87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e98f0f-f551-454d-83dc-72ea335bfab1", "name": "network-vif-plugged", "status": "completed", "tag": "5457fda6-471c-4e1e-af4a-0d995f51f52f"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:50.774456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:16:50.774456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:16:50.782176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-70ba4d16-0509-462c-9e71-33ac495d8194 req-9c08d7b2-0863-44fc-8cd5-26acf3dbe87f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:50.782699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-70ba4d16-0509-462c-9e71-33ac495d8194 req-9c08d7b2-0863-44fc-8cd5-26acf3dbe87f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:50.793515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-70ba4d16-0509-462c-9e71-33ac495d8194 req-9c08d7b2-0863-44fc-8cd5-26acf3dbe87f service nova] Creating event network-vif-plugged:5457fda6-471c-4e1e-af4a-0d995f51f52f for instance a5e98f0f-f551-454d-83dc-72ea335bfab1 on hv-cinder-79053 Dec 09 01:16:50.798729 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-70ba4d16-0509-462c-9e71-33ac495d8194 req-9c08d7b2-0863-44fc-8cd5-26acf3dbe87f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029637 Dec 09 01:16:50.799368 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 491/1032] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:16:51.086501 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:51.087120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:51.093999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:51.094380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:51.095612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:51.096234 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:51.185593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:51.186347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:51.193119 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:51.193617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:51.194435 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:51.194875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:51.232783 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:51.241357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-e22e5b6f-24a8-4695-9915-047d7e814bd6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1264 microversion: 2.1 time: 0.159301 Dec 09 01:16:51.241923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 542/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:51 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:51.334414 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:51.343151 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:51.344692 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:51.345852 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b0a518d3-82bb-4ce7-b888-de04d871f01b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.164691 Dec 09 01:16:51.346432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 492/1034] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:51 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:16:52.257971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:52.258612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:52.264876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.265322 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.266130 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.266602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.364633 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:52.365241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:52.371406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.371847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.372616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.373050 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.397604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:52.405474 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4bfa2246-22b7-485d-95ce-f4b89de1a196 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1451 microversion: 2.1 time: 0.150676 Dec 09 01:16:52.411132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 543/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:52 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:16:52.422647 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:52.423349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:52.429364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.429883 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.430764 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:52.431273 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:52.537930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:52.546832 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:52.548525 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:52.549884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-4d34e8aa-d710-4381-adb9-4e9c8def5cea tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1744 microversion: 2.20 time: 0.189010 Dec 09 01:16:52.550470 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 493/1036] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:52 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:16:52.603143 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:52.611100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b2e1c872-79ec-484f-802e-4784833a7f92 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1451 microversion: 2.1 time: 0.192905 Dec 09 01:16:52.611669 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 544/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:16:52 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:16:53.568342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:53.568953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:53.575512 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:53.576542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:53.577816 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:53.578083 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:53.804313 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:53.813332 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:53.814870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:53.816015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-05479733-2c57-431c-b323-4953427ae295 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1744 microversion: 2.20 time: 0.251394 Dec 09 01:16:53.816581 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 494/1038] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:53 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:54.408733 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-149eb8af-d4af-4955-b29d-be2caea15b34 req-2c90bb35-b736-4f89-ae3b-07f2148d7675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e98f0f-f551-454d-83dc-72ea335bfab1", "tag": "5457fda6-471c-4e1e-af4a-0d995f51f52f"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:54.413016 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:16:54.413016 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:16:54.420989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-149eb8af-d4af-4955-b29d-be2caea15b34 req-2c90bb35-b736-4f89-ae3b-07f2148d7675 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:54.421716 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-149eb8af-d4af-4955-b29d-be2caea15b34 req-2c90bb35-b736-4f89-ae3b-07f2148d7675 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:54.432724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-149eb8af-d4af-4955-b29d-be2caea15b34 req-2c90bb35-b736-4f89-ae3b-07f2148d7675 service nova] Creating event network-changed:5457fda6-471c-4e1e-af4a-0d995f51f52f for instance a5e98f0f-f551-454d-83dc-72ea335bfab1 on hv-cinder-79053 Dec 09 01:16:54.438617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-149eb8af-d4af-4955-b29d-be2caea15b34 req-2c90bb35-b736-4f89-ae3b-07f2148d7675 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033719 Dec 09 01:16:54.439806 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 545/1039] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:16:54.834030 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-aa3ff7ab-1858-438e-8e66-6569cf1e23cf req-ac369d99-6a68-47a7-a112-f5b3fafb2e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "name": "network-vif-plugged", "status": "completed", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:16:54.834612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:54.835471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:54.837379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:16:54.837379 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:16:54.846030 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:54.848148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:54.848979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:54.849424 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:54.856145 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-aa3ff7ab-1858-438e-8e66-6569cf1e23cf req-ac369d99-6a68-47a7-a112-f5b3fafb2e35 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:54.859484 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-aa3ff7ab-1858-438e-8e66-6569cf1e23cf req-ac369d99-6a68-47a7-a112-f5b3fafb2e35 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:54.891641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-aa3ff7ab-1858-438e-8e66-6569cf1e23cf req-ac369d99-6a68-47a7-a112-f5b3fafb2e35 service nova] Creating event network-vif-plugged:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:16:54.897354 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-aa3ff7ab-1858-438e-8e66-6569cf1e23cf req-ac369d99-6a68-47a7-a112-f5b3fafb2e35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066856 Dec 09 01:16:54.898625 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 495/1040] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:16:55.067458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:55.076079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:55.079048 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:55.080819 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2c6656f4-b774-4782-bfa5-420419b6295d tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.250458 Dec 09 01:16:55.081378 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 546/1041] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:54 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:56.103178 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:56.103865 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:56.110994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:56.111763 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:56.112786 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:56.113424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:56.270141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:56.278908 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:56.280821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:56.282293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ef5fb3d7-1c82-4780-8106-90957af703d2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.186115 Dec 09 01:16:56.283120 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 496/1042] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:56 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:57.300706 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:57.301331 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:57.310531 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:57.310995 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:57.311802 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:57.312249 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:57.452171 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:57.461962 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:57.463774 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:57.464933 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d307378a-e439-4f5f-9a79-e1fa0321f2b9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.167979 Dec 09 01:16:57.465795 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 547/1043] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:57 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:58.484123 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:58.484875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:58.491582 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:58.492046 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:58.492824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:58.493261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:58.651327 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:58.660611 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:58.664203 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:58.665393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-99308594-665d-4b33-969d-007e3a0c3b4b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.185195 Dec 09 01:16:58.666399 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 497/1044] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:58 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:16:59.683536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:16:59.684136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:16:59.692476 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:59.692923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:59.693712 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:16:59.694154 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:16:59.834015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:59.845044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:59.850199 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:16:59.851567 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c09c2d02-381f-4b46-b0d7-e80dfe1eb41b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.171724 Dec 09 01:16:59.854007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 548/1045] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:16:59 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:00.868998 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:00.869702 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:00.877149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:00.877602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:00.878556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:00.879001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:01.035095 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:01.044946 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:01.047252 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:01.048443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-350fcecc-ad28-43aa-95b5-7a4f2f8c3993 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.183204 Dec 09 01:17:01.049219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 498/1046] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:00 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:01.661386 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:17:01.661730 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:17:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:17:02.066283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:02.067557 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:02.075649 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:02.076263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:02.077920 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:02.078358 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:02.238793 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:02.247312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:02.249861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:02.251144 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2d930659-2a3b-46b8-916b-de91f5d6660f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.188510 Dec 09 01:17:02.255822 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 549/1047] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:02 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:03.272063 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:03.272752 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:03.288737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:03.289202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:03.290010 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:03.290720 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:03.442299 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:03.455775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:03.457260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:03.458459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-16baeb5a-25b0-48f5-a8f6-7f698ac7092c tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.190417 Dec 09 01:17:03.470536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 499/1048] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:03 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:04.478843 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:04.479575 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:04.486655 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:04.487117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:04.487916 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:04.488361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:04.621021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:04.629355 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:04.630879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:04.632029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5dd304b3-58b9-4bcf-aa76-03e5770574dc tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1739 microversion: 2.20 time: 0.156877 Dec 09 01:17:04.632590 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 550/1049] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:04 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:05.089315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:05.089893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:05.096086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.096665 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.097460 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.097904 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.120461 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.objects.instance [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lazy-loading 'flavor' on Instance uuid c6445f5b-75ee-4efe-944e-2084d36836ce {{(pid=116067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:17:05.192824 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ce9d6864-318d-4b3c-a196-482003935cbc tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "POST /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce/action" status: 202 len: 0 microversion: 2.1 time: 0.107049 Dec 09 01:17:05.193394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 500/1050] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:17:05 2021] POST /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:17:05.201430 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:05.202222 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:05.208619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.209084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.210137 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.210604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.347895 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:05.355457 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-61af4784-52df-422e-af84-aea5f813b68c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.157691 Dec 09 01:17:05.356077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 551/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:05 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:05.651494 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:05.652115 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:05.659532 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.659994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.660778 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:05.661223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:05.795742 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:05.803442 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:05.804936 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:05.806082 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-51baf6c5-b9bf-4c6e-93b7-bb2d8e1c52b1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1721 microversion: 2.20 time: 0.158863 Dec 09 01:17:05.806663 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 501/1052] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:05 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:06.374004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:06.374715 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:06.380856 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:06.381300 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:06.382067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:06.382536 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:06.511722 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:06.518889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-992f93a4-68a8-4160-80fb-7e1e7df77841 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.149403 Dec 09 01:17:06.519452 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 552/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:06 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:06.824609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:06.825216 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:06.831994 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:06.832447 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:06.833219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:06.833660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:06.971733 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:06.979987 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:06.981464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:06.983317 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-268bacb1-3121-44d3-90b4-7ebe1804e571 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1721 microversion: 2.20 time: 0.161709 Dec 09 01:17:06.983914 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 502/1054] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:06 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:07.535867 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:07.536470 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:07.542626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:07.543078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:07.543846 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:07.544283 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:07.677755 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:07.685029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b44f88fa-2b8b-47fd-baaa-bec159856ef1 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.152780 Dec 09 01:17:07.685581 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 553/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:07 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:08.003657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:08.004554 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.010888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.011333 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.012105 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.012540 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.140081 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:08.147738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:08.149253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:08.150414 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b5ef5751-6dfb-401c-a9ca-4ac60006edd1 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1664 microversion: 2.20 time: 0.151782 Dec 09 01:17:08.150965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 503/1056] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:07 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:08.168368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff5a4181-1d11-4248-8a08-b3bc4aa8e8cd"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:08.169459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.176193 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.176638 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.177407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.177836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.440849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-bf827489-7141-48b8-9649-f04dc6f2f3a5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276303 Dec 09 01:17:08.441449 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 554/1057] 10.222.0.23 () {62 vars in 1363 bytes} [Thu Dec 9 01:17:08 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments => generated 188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 09 01:17:08.549249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:08.549795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.555600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.556048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.556817 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.557244 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.702018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:08.702842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.710125 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.710617 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.711407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.711854 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.808809 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d5212930-d8cb-4ca9-9789-13eec4802be5 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments/ff5a4181-1d11-4248-8a08-b3bc4aa8e8cd" status: 202 len: 0 microversion: 2.20 time: 0.263272 Dec 09 01:17:08.809449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 504/1058] 10.222.0.23 () {60 vars in 1456 bytes} [Thu Dec 9 01:17:08 2021] DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments/ff5a4181-1d11-4248-8a08-b3bc4aa8e8cd => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:17:08.870690 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:08.876709 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:08.877285 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.879801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-49ade6d0-06f4-4ffe-bde1-6ce7ce75b5e3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.181515 Dec 09 01:17:08.880359 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 555/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:08 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:17:08.883888 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.884416 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.885699 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.886208 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.972242 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ccccae0b-0d21-4fab-9806-182bd3548dec tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action" status: 202 len: 0 microversion: 2.20 time: 0.099806 Dec 09 01:17:08.972865 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 505/1060] 10.222.0.23 () {62 vars in 1318 bytes} [Thu Dec 9 01:17:08 2021] POST /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:17:08.987119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-ed3370a3-2c4c-4a71-842b-f2190370d4c0 req-393d9d29-5509-4ef3-8006-ccc364636f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "name": "network-vif-unplugged", "status": "completed", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:08.989586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:17:08.989586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:17:08.989803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:08.990310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:08.996924 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.997576 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.998061 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-ed3370a3-2c4c-4a71-842b-f2190370d4c0 req-393d9d29-5509-4ef3-8006-ccc364636f64 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.998459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:08.998967 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-ed3370a3-2c4c-4a71-842b-f2190370d4c0 req-393d9d29-5509-4ef3-8006-ccc364636f64 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:08.999417 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:09.011940 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.compute.server_external_events [req-ed3370a3-2c4c-4a71-842b-f2190370d4c0 req-393d9d29-5509-4ef3-8006-ccc364636f64 service nova] Unable to find a host for instance e2406c5f-f317-423f-a675-5c32962ef6fb. Dropping event network-vif-unplugged {{(pid=116068) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 09 01:17:09.013228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-ed3370a3-2c4c-4a71-842b-f2190370d4c0 req-393d9d29-5509-4ef3-8006-ccc364636f64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030500 Dec 09 01:17:09.014082 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 556/1061] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 09 01:17:09.138069 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:09.146584 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:09.148078 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:09.149221 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b4c2a7ab-241a-4bd9-9f6f-b25534d5d104 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1672 microversion: 2.20 time: 0.164747 Dec 09 01:17:09.149765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 506/1062] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:08 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:09.897202 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:09.897864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:09.904033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:09.904478 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:09.905785 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:09.906220 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:10.042896 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:10.051327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-24be6fb8-defa-4888-b0f9-2f8c1c2b967c tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.157781 Dec 09 01:17:10.051889 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 557/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:09 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:10.168408 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:10.169012 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:10.176769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:10.177224 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:10.178018 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:10.178481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:10.317483 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:10.325600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:10.328166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:10.329357 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bd0b0db4-a96e-4a1b-90c0-5b55b818f86e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.165775 Dec 09 01:17:10.329923 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 507/1064] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:10 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:11.069059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:11.069676 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:11.075952 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:11.076739 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:11.077560 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:11.078216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:11.214551 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:11.222547 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-55d00a4b-d696-42c7-ac6b-d931d3aab702 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.157181 Dec 09 01:17:11.223112 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 558/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:11 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:11.348086 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:11.348984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:11.354962 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:11.355417 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:11.356238 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:11.356617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:11.520819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:11.531965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:11.534157 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:11.535407 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8b49af66-8efe-4a40-884c-5d52d61de678 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.191004 Dec 09 01:17:11.535972 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 508/1066] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:11 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:12.242145 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:12.242780 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:12.249263 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:12.249925 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:12.250724 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:12.251168 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:12.400849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:12.408312 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-024c30a1-a110-4632-a289-3d72fbe6e251 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.170995 Dec 09 01:17:12.408883 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 559/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:12 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:12.554641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:12.555479 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:12.561873 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:12.562324 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:12.563147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:12.563588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:12.702908 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:12.711286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:12.712776 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:12.713927 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-98f4ec09-5fd0-4ecc-9815-146ac4654df9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.163403 Dec 09 01:17:12.714505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 509/1068] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:12 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:17:13.425394 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:13.426054 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:13.432722 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:13.433181 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:13.433979 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:13.434459 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:13.572321 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:13.580592 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b2536f35-4c1e-4352-997e-94974a8ff349 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.159159 Dec 09 01:17:13.581368 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 560/1069] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:13 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:13.732853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:13.734389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:13.741642 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:13.742141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:13.743176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:13.743927 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:13.889176 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:13.897700 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:13.899757 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:13.901319 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6cd5c507-8c73-4dbb-bf54-3463fd633762 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.172273 Dec 09 01:17:13.902149 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 510/1070] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:13 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:14.597299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:14.597917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:14.604248 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:14.604702 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:14.605487 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:14.605923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:14.749641 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:14.758489 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-579984ed-e857-4a5f-8f6a-9c371200d260 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.164465 Dec 09 01:17:14.759236 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 561/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:14 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:14.919845 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:14.921062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:14.927961 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:14.928449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:14.929236 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:14.929683 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:15.081020 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:15.089819 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:15.091475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:15.093281 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-8b8cddc8-dd34-420d-9efc-988fe0a3ba0e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.177132 Dec 09 01:17:15.094088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 511/1072] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:14 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:15.775036 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:15.775697 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:15.782861 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:15.783315 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:15.784099 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:15.784543 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:15.939243 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:15.946571 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-58fbf0b6-e30e-41dd-9e45-f83f12464921 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.175186 Dec 09 01:17:15.947141 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 562/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:15 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:16.111949 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:16.112528 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:16.119034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:16.119488 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:16.120305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:16.120803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:16.262656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:16.271887 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:16.273394 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:16.274600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-12fe008e-8f7d-4887-bf16-e274b0daedbd tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.166912 Dec 09 01:17:16.275393 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 512/1074] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:16 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:16.964228 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:16.965288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:16.975972 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:16.976424 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:16.977218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:16.978192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:17.116623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:17.124612 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a84ef8db-2392-4ba3-8f0d-9e454e3dd88f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.164252 Dec 09 01:17:17.125086 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 563/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:16 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:17.296727 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:17.297341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:17.304477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:17.304926 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:17.305714 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:17.306147 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:17.445191 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:17.453624 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:17.455128 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:17.456277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6a06fd71-d5ca-4c50-92bd-9d680e08b121 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.163350 Dec 09 01:17:17.456853 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 513/1076] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:17 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:18.141538 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:18.142103 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:18.148364 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:18.148813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:18.149592 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:18.150070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:18.291768 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:18.299677 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ef857fd2-8bea-4670-a596-64dcbe161dec tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.161872 Dec 09 01:17:18.300242 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 564/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:18 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:18.474992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:18.475516 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:18.492598 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:18.493055 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:18.493863 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:18.494305 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:18.652837 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:18.660870 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:18.662334 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:18.663494 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c3ed7771-e84a-4be4-b739-8549dfa66f32 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.192315 Dec 09 01:17:18.664047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 514/1078] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:18 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:19.317119 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:19.317704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:19.323984 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:19.324427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:19.325192 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:19.325626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:19.466585 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:19.474501 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-83c36370-be34-4c2d-a197-0df2437bc1a3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.160961 Dec 09 01:17:19.475065 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 565/1079] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:19 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:19.684336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:19.685154 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:19.692744 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:19.693497 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:19.694617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:19.695278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:19.861021 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:19.869062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:19.870616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:19.871798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-976824a7-d8a9-49a1-9d4a-d4f74edb4d1e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.192369 Dec 09 01:17:19.872641 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 515/1080] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:19 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:20.491871 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:20.492558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:20.498959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:20.499411 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:20.500196 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:20.500635 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:20.638252 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:20.646621 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4df969e1-c0d3-4228-b782-78de7f1ba07b tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.158331 Dec 09 01:17:20.647401 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 566/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:20 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:20.891071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:20.891701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:20.898101 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:20.898595 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:20.899372 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:20.899812 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:21.036195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:21.044090 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:21.046004 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:21.047234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-22288dbe-f1b0-4bb5-9ef0-696575defad7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.160735 Dec 09 01:17:21.047795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 516/1082] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:20 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:21.664393 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:21.664997 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:21.671855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:21.672299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:21.673070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:21.673570 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:21.810587 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:21.818947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-94e46501-7474-4c6d-84bf-771fea8e5758 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.158180 Dec 09 01:17:21.819514 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 567/1083] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:21 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:22.065430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:22.066034 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:22.072276 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:22.072729 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:22.073506 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:22.073953 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:22.218660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:22.227113 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:22.228602 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:22.229765 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0984f2b9-226d-46c0-9572-f7e579f1fc6e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.168601 Dec 09 01:17:22.230321 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 517/1084] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:22 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:17:22.837017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:22.837661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:22.844002 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:22.845038 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:22.845853 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:22.846274 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:22.976835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:22.984298 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-ebca4e54-c729-4340-ae32-8d948725fe66 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.151231 Dec 09 01:17:22.984864 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 568/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:22 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:23.248183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:23.248895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:23.255202 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:23.255651 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:23.256434 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:23.256871 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:23.387710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:23.395772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:23.397400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:23.398580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-38e610fa-cefc-4a10-b9d8-84a7813d5786 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.154159 Dec 09 01:17:23.399146 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 518/1086] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:23 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:24.001414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:24.002033 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:24.008388 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:24.008841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:24.009623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:24.010064 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:24.140253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:24.147652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9f71474a-18f9-470b-b58d-d3489d194786 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.150598 Dec 09 01:17:24.148217 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 569/1087] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:23 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:24.416941 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:24.417494 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:24.424388 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:24.424839 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:24.425620 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:24.426058 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:24.555800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:24.564248 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:24.565745 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:24.566922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-f97c7a13-1fbc-47a7-a523-7843aefa44b7 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.153782 Dec 09 01:17:24.567481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 519/1088] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:24 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:25.164549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:25.165153 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:25.171696 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:25.172143 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:25.172915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:25.173346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:25.536579 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:25.543874 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-6f956a49-76ea-4869-ae51-aaea02d54708 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.382950 Dec 09 01:17:25.544437 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 570/1089] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:25 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:25.585005 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:25.585609 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:25.591867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:25.592449 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:25.593151 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:25.593737 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:25.726297 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:25.735456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:25.737137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:25.738644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5e797c62-6f24-49d3-aa53-54bec0acf932 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.157841 Dec 09 01:17:25.739673 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 520/1090] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:25 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:26.560723 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:26.561662 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:26.567632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.568079 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.568851 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.569288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.707433 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:26.714949 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a5b2a7ee-787f-488a-a09d-d1268daf8afb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1508 microversion: 2.1 time: 0.157988 Dec 09 01:17:26.715512 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 571/1091] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:26 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:26.735318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:26.735889 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:26.742472 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.742931 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.743718 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.744164 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.756557 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:26.757652 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:26.763442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.763900 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.765191 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.765628 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.833580 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9f1ace17-691e-4bc9-8d35-5c564e99ef3e tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "POST /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce/action" status: 202 len: 0 microversion: 2.1 time: 0.100111 Dec 09 01:17:26.834629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 521/1092] 10.222.0.23 () {60 vars in 1277 bytes} [Thu Dec 9 01:17:26 2021] POST /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:17:26.844138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:26.844785 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:26.851358 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.852074 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.852885 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:26.854057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:26.935126 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:26.953053 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:26.954664 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:26.955875 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4d45b874-6b6d-4ea9-8564-d97ba90e2d64 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.202915 Dec 09 01:17:26.968370 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 572/1093] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:26 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:27.012767 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:27.022632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-057fa37c-7d68-4c38-81d0-a2fa78bb83b3 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1516 microversion: 2.1 time: 0.183437 Dec 09 01:17:27.023213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 522/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:26 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:27.973471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:27.974081 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:27.982055 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:27.982533 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:27.983427 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:27.984186 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:28.039919 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:28.040515 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:28.047481 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:28.047930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:28.049127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:28.049738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:28.160020 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:28.168341 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:28.169844 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:28.172450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-37591c51-aebc-474a-a284-0c52936cb2b6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.202721 Dec 09 01:17:28.173017 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 573/1095] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:27 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:17:28.221597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:28.228985 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-26c65030-c211-4daf-ac8c-655583143b95 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1518 microversion: 2.1 time: 0.192742 Dec 09 01:17:28.229545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 523/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:28 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:28.931495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-00136472-ca16-429c-9f11-daa8f6483ffb req-6c5b7595-eb73-4159-a8a9-98ec2fec5ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "name": "network-vif-plugged", "status": "completed", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:28.932926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:17:28.932926 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:17:28.941015 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-00136472-ca16-429c-9f11-daa8f6483ffb req-6c5b7595-eb73-4159-a8a9-98ec2fec5ab2 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:28.941569 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-00136472-ca16-429c-9f11-daa8f6483ffb req-6c5b7595-eb73-4159-a8a9-98ec2fec5ab2 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:28.953554 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-00136472-ca16-429c-9f11-daa8f6483ffb req-6c5b7595-eb73-4159-a8a9-98ec2fec5ab2 service nova] Creating event network-vif-plugged:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:17:28.959556 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-00136472-ca16-429c-9f11-daa8f6483ffb req-6c5b7595-eb73-4159-a8a9-98ec2fec5ab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Dec 09 01:17:28.960018 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 574/1097] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:17:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:17:29.190805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:29.191851 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:29.199340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:29.199799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:29.201260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:29.201714 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:29.248039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:29.248989 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:29.255495 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:29.256299 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:29.257316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:29.257753 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:29.397391 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:29.407693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:29.409300 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:29.410658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-86972ae5-7965-4dbd-be3d-fa24ba3f35f0 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.223591 Dec 09 01:17:29.411307 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 524/1098] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:29 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:29.446515 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:29.455803 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9796fdda-202e-463b-949a-68006038a7d6 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.212165 Dec 09 01:17:29.456379 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 575/1099] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:29 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:17:30.430589 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:30.431252 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:30.438835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:30.439293 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:30.440121 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:30.440616 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:30.473705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:30.474586 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:30.481277 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:30.482078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:30.482977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:30.483614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:30.647605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:30.655991 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:30.658262 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:30.663801 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3c8fc0a8-7e64-412f-aa47-e2fcb67ca29f tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1730 microversion: 2.20 time: 0.236982 Dec 09 01:17:30.675062 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 525/1100] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:30 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:30.679480 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:30.688573 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f89e56f2-f3f1-4a37-b576-bc29e4da44df tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.219317 Dec 09 01:17:30.689543 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 576/1101] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:30 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:17:30.997601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-25c0e3b2-e53a-44ba-a7d2-a71eafd636f1 req-4d1955f0-4991-4ee0-9e87-1f79eadfd737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "name": "network-vif-unplugged", "status": "completed", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:30.999272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:17:30.999272 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:17:31.006762 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-25c0e3b2-e53a-44ba-a7d2-a71eafd636f1 req-4d1955f0-4991-4ee0-9e87-1f79eadfd737 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:31.007215 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-25c0e3b2-e53a-44ba-a7d2-a71eafd636f1 req-4d1955f0-4991-4ee0-9e87-1f79eadfd737 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:31.019492 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-25c0e3b2-e53a-44ba-a7d2-a71eafd636f1 req-4d1955f0-4991-4ee0-9e87-1f79eadfd737 service nova] Creating event network-vif-unplugged:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:17:31.024335 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-25c0e3b2-e53a-44ba-a7d2-a71eafd636f1 req-4d1955f0-4991-4ee0-9e87-1f79eadfd737 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030462 Dec 09 01:17:31.024922 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 526/1102] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:17:31.684825 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:31.685438 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:31.692669 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:31.693122 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:31.693906 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:31.694349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:31.705979 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:31.706728 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:31.713381 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:31.713828 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:31.714635 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:31.715071 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:31.888931 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:31.897759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:31.899276 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:31.900431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-912dca04-6ce5-4257-ac4c-8e89a9faecf2 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1717 microversion: 2.20 time: 0.219358 Dec 09 01:17:31.900999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 577/1103] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:17:31 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:17:31.902842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:31.910896 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-23b326b4-673e-427e-8415-5f91eb256079 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.209347 Dec 09 01:17:31.911538 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 527/1104] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:31 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:17:32.928129 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:32.928674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:32.934965 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:32.935414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:32.936221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:32.936661 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:33.068713 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:33.076022 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-507f385d-852e-4dd5-b3ab-5976145f0ced tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.151612 Dec 09 01:17:33.076589 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 578/1105] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:32 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:34.092795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:34.093400 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:34.099779 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:34.100283 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:34.100997 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:34.101430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:34.233795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:34.241967 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-897f7e67-ecb6-4d99-bba6-bbe9e610411f tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.152835 Dec 09 01:17:34.242605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 528/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:34 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:35.260295 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:35.260824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:35.268614 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:35.269063 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:35.269834 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:35.270265 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:35.403163 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:35.410670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-8e5a59cb-7a22-4020-bd5e-5227c9200818 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.154376 Dec 09 01:17:35.411233 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 579/1107] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:35 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:36.426710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:36.427324 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:36.433571 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:36.434025 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:36.434836 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:36.435277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:36.567474 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:36.574745 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d76982e5-938a-4475-8eca-284cdba50e3d tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1574 microversion: 2.1 time: 0.151687 Dec 09 01:17:36.575304 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 529/1108] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:36 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:37.592195 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:17:37.592813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:17:37.599092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:37.599535 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:37.600416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:37.600854 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:37.735150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:17:37.742345 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0dea0d6d-02e7-404b-a164-03849d722c01 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1561 microversion: 2.1 time: 0.153829 Dec 09 01:17:37.742927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 580/1109] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:17:37 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:17:40.984813 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-845dd182-3973-466f-8a86-ec32a40bd93a req-f88290b9-0d7d-43cb-bbfa-c3b94cc8bca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "name": "network-vif-plugged", "status": "completed", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:17:40.986770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:17:40.986770 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:17:40.994135 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-845dd182-3973-466f-8a86-ec32a40bd93a req-f88290b9-0d7d-43cb-bbfa-c3b94cc8bca5 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:17:40.994629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-845dd182-3973-466f-8a86-ec32a40bd93a req-f88290b9-0d7d-43cb-bbfa-c3b94cc8bca5 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:17:41.006808 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-845dd182-3973-466f-8a86-ec32a40bd93a req-f88290b9-0d7d-43cb-bbfa-c3b94cc8bca5 service nova] Creating event network-vif-plugged:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:17:41.011696 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-845dd182-3973-466f-8a86-ec32a40bd93a req-f88290b9-0d7d-43cb-bbfa-c3b94cc8bca5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031037 Dec 09 01:17:41.012284 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 530/1110] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:05.615180 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:05.616148 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:05.621935 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.622537 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.623203 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.623654 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.652144 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-526820ab-53bc-4a06-909c-49537faea11b tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041938 Dec 09 01:18:05.652687 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 581/1111] 10.222.0.23 () {60 vars in 1342 bytes} [Thu Dec 9 01:18:05 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:05.713648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:05.714234 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:05.720261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.720716 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.722048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.722772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.747130 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Going to try to terminate instance {{(pid=116067) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:18:05.823728 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-aeaf6ff1-31a0-4a80-a2b2-ee3a98883cbe tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 204 len: 0 microversion: 2.20 time: 0.114120 Dec 09 01:18:05.824432 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 531/1112] 10.222.0.23 () {60 vars in 1279 bytes} [Thu Dec 9 01:18:05 2021] DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 09 01:18:05.832466 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:05.833465 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:05.839297 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.839744 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.840544 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:05.840988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:05.969390 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:05.981689 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:05.983400 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:05.984575 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-828643b3-9a34-458b-887d-e343f6d0b374 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.156007 Dec 09 01:18:05.985142 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 582/1113] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:18:05 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 09 01:18:07.004015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:07.004626 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:07.010778 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:07.011223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:07.011992 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:07.012424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:07.147217 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:07.154893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:07.156366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:07.157505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-10a9bc96-9c03-4f66-b293-e7d53df90aff tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1723 microversion: 2.20 time: 0.158417 Dec 09 01:18:07.158059 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 532/1114] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:18:06 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:18:08.175971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:08.176602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:08.182944 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:08.183396 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:08.184182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:08.184623 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:08.244574 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-a6863076-623b-466c-869e-06683d967134 req-00437748-773e-49af-8a3e-dbda45a2cd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2406c5f-f317-423f-a675-5c32962ef6fb", "name": "network-vif-deleted", "tag": "48fc2252-240d-4b5b-9f88-4769abf67db6"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:08.246228 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:18:08.246228 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:18:08.257430 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-a6863076-623b-466c-869e-06683d967134 req-00437748-773e-49af-8a3e-dbda45a2cd12 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:08.258210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-a6863076-623b-466c-869e-06683d967134 req-00437748-773e-49af-8a3e-dbda45a2cd12 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:08.262553 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:08.272420 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:08.272735 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-a6863076-623b-466c-869e-06683d967134 req-00437748-773e-49af-8a3e-dbda45a2cd12 service nova] Creating event network-vif-deleted:48fc2252-240d-4b5b-9f88-4769abf67db6 for instance e2406c5f-f317-423f-a675-5c32962ef6fb on hv-cinder-79053 Dec 09 01:18:08.274424 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e10d73a08d6e43e79df2c2e1d3161b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e237e82cdcf24c93b91e0c1799f78928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:08.275794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-62921e6a-8134-48fc-82f6-6364e1e5c53a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 200 len: 1655 microversion: 2.20 time: 0.104119 Dec 09 01:18:08.276555 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 583/1115] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:18:08 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 09 01:18:08.279740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-a6863076-623b-466c-869e-06683d967134 req-00437748-773e-49af-8a3e-dbda45a2cd12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039041 Dec 09 01:18:08.280850 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 533/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:18:09.294177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:09.294849 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:09.301311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:09.301759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:09.302565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:09.302999 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:09.316010 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. Dec 09 01:18:09.316582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:09.317385 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-de0c93cf-ed09-475f-9e07-6186781b01a6 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 404 len: 111 microversion: 2.20 time: 0.026976 Dec 09 01:18:09.317898 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 584/1117] 10.222.0.23 () {60 vars in 1276 bytes} [Thu Dec 9 01:18:09 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 09 01:18:09.326682 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0dd717bb-f947-4a34-ba9e-490eae49c41a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '.version_select at 0x7fe619e44550>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:09.329895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dd717bb-f947-4a34-ba9e-490eae49c41a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [25e3fc58-15ce-4550-a87f-72d009eedfe1] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 09 01:18:10.348761 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dd717bb-f947-4a34-ba9e-490eae49c41a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [25e3fc58-15ce-4550-a87f-72d009eedfe1] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 50862. Dec 09 01:18:10.368618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0dd717bb-f947-4a34-ba9e-490eae49c41a tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175306158" status: 204 len: 0 microversion: 2.20 time: 1.045905 Dec 09 01:18:10.369194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 534/1118] 10.222.0.23 () {60 vars in 1261 bytes} [Thu Dec 9 01:18:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175306158 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 09 01:18:12.104237 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:12.104708 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:12.110923 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:12.111491 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:12.112269 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:12.112703 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:12.125839 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. Dec 09 01:18:12.126530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:12.127351 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-191d74e9-da2d-4e68-b6b6-9bde3fd2aee9 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 404 len: 111 microversion: 2.1 time: 0.026827 Dec 09 01:18:12.127893 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 585/1119] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:18:12 2021] DELETE /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:12.135865 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:12.136604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: e2406c5f-f317-423f-a675-5c32962ef6fb] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:12.142626 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:12.143599 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:12.144413 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:12.144857 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:12.157701 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. Dec 09 01:18:12.158290 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance e2406c5f-f317-423f-a675-5c32962ef6fb could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:12.159849 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0d9a8895-6d7d-47c4-93dc-2c8f101a468e tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb" status: 404 len: 111 microversion: 2.1 time: 0.028069 Dec 09 01:18:12.160374 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 535/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:12 2021] GET /compute/v2.1/servers/e2406c5f-f317-423f-a675-5c32962ef6fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:13.285260 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:13.285770 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:13.291881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:13.292327 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:13.293089 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:13.293520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:13.306934 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. Dec 09 01:18:13.307505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:13.308298 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-94cd066f-1ebc-476c-9891-ede421116398 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 404 len: 111 microversion: 2.1 time: 0.027299 Dec 09 01:18:13.308836 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 586/1121] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:18:13 2021] DELETE /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:13.317505 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:13.318122 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] [instance: 1515b060-5e76-4152-acbc-e3affaca18e2] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:13.324395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:13.324844 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:13.325618 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:13.326057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:13.341950 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] HTTP exception thrown: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. Dec 09 01:18:13.342560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] Returning 404 to user: Instance 1515b060-5e76-4152-acbc-e3affaca18e2 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:13.343387 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bc180fda-91c3-4bff-b6c3-bc55a6605b79 tempest-AttachVolumeShelveTestJSON-612986161 tempest-AttachVolumeShelveTestJSON-612986161-project] 10.222.0.23 "GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2" status: 404 len: 111 microversion: 2.1 time: 0.030662 Dec 09 01:18:13.343886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 536/1122] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:13 2021] GET /compute/v2.1/servers/1515b060-5e76-4152-acbc-e3affaca18e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:17.688461 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0b080243-58f0-4301-9ae6-fc631ff0f9dc tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Action: 'create', calling method: .version_select at 0x7fe61a7588b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-454536917"}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:17.958842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0b080243-58f0-4301-9ae6-fc631ff0f9dc tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.379374 Dec 09 01:18:17.959932 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 587/1123] 10.222.0.23 () {60 vars in 1154 bytes} [Thu Dec 9 01:18:17 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 381 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 09 01:18:17.970619 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-726e4265-a5f4-42a8-bd0a-e95e31139aa4 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619d81310>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:18.019206 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-726e4265-a5f4-42a8-bd0a-e95e31139aa4 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 200 len: 344 microversion: 2.1 time: 0.052382 Dec 09 01:18:18.019771 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 537/1124] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:18:17 2021] GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:19.032357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a58962f7-943c-4672-8238-7c0e6283c64c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a79b700>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:19.087060 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a58962f7-943c-4672-8238-7c0e6283c64c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 200 len: 345 microversion: 2.1 time: 0.058802 Dec 09 01:18:19.087626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 588/1125] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:18:19 2021] GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:19.099383 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fdad94e0-5b41-4bde-9cc2-f9e8e27047f3 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Action: 'create', calling method: .version_select at 0x7fe619f87dc0>, body: {"snapshot": {"volume_id": "7601dc4d-35cd-4752-b3f6-31771a4efe6f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-100075115"}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:19.237317 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fdad94e0-5b41-4bde-9cc2-f9e8e27047f3 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.141841 Dec 09 01:18:19.237859 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 538/1126] 10.222.0.23 () {60 vars in 1161 bytes} [Thu Dec 9 01:18:19 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:19.248114 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c718b246-0a2b-46eb-9c71-494a1eae14f5 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a7a4b80>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:19.277414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c718b246-0a2b-46eb-9c71-494a1eae14f5 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 286 microversion: 2.1 time: 0.033690 Dec 09 01:18:19.278123 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 589/1127] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:19 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:19.288200 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ce2cc068-54be-47c2-a416-514c4869ce4a tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619ecb550>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:19.317457 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ce2cc068-54be-47c2-a416-514c4869ce4a tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033596 Dec 09 01:18:19.318013 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 539/1128] 10.222.0.23 () {58 vars in 1139 bytes} [Thu Dec 9 01:18:19 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:19.328057 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c01778df-d860-40d5-a873-035d4a7e4ed0 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a7581f0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:19.357209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c01778df-d860-40d5-a873-035d4a7e4ed0 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 286 microversion: 2.1 time: 0.033249 Dec 09 01:18:19.357759 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 590/1129] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:19 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:20.368965 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a9d46f3c-d5ea-4e8d-8b9c-1ae37e3802ab tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619e2ce50>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:20.397617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a9d46f3c-d5ea-4e8d-8b9c-1ae37e3802ab tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 286 microversion: 2.1 time: 0.032638 Dec 09 01:18:20.398183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 540/1130] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:20 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:21.409970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-3353ffb0-25cf-4a01-af35-31fa7b5d1fa2 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a79ba60>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:21.438343 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-3353ffb0-25cf-4a01-af35-31fa7b5d1fa2 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 286 microversion: 2.1 time: 0.033140 Dec 09 01:18:21.438932 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 591/1131] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:21 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:22.451155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-d6d2e972-3095-473b-965b-a5eff28ae987 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619e44ca0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:22.480352 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-d6d2e972-3095-473b-965b-a5eff28ae987 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 287 microversion: 2.1 time: 0.033309 Dec 09 01:18:22.481003 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 541/1132] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:22 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:22.492516 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-7b2ed50d-4eb7-44ec-ae4b-fe89d98c6399 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a761e50>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:22.546645 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-7b2ed50d-4eb7-44ec-ae4b-fe89d98c6399 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 202 len: 0 microversion: 2.1 time: 0.058248 Dec 09 01:18:22.547209 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 592/1133] 10.222.0.23 () {58 vars in 1253 bytes} [Thu Dec 9 01:18:22 2021] DELETE /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:18:22.556756 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3ade0212-27b3-4884-a5a1-1ccd68c2782a tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a101a60>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:22.585766 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3ade0212-27b3-4884-a5a1-1ccd68c2782a tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 200 len: 286 microversion: 2.1 time: 0.033320 Dec 09 01:18:22.586339 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 542/1134] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:22 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:23.597520 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-860ab22c-bef3-4093-8d1b-655b0294ff83 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a7beee0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:23.620913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-860ab22c-bef3-4093-8d1b-655b0294ff83 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] HTTP exception thrown: Snapshot c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 could not be found. Dec 09 01:18:23.621488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-860ab22c-bef3-4093-8d1b-655b0294ff83 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Returning 404 to user: Snapshot c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:23.622278 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-860ab22c-bef3-4093-8d1b-655b0294ff83 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9" status: 404 len: 111 microversion: 2.1 time: 0.029063 Dec 09 01:18:23.622824 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 593/1135] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:23 2021] GET /compute/v2.1/os-snapshots/c1c3d31e-7443-4c2f-ba2f-22f7952fefb9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:23.631588 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-43a42428-fb34-4990-ae69-537fd6ae3475 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619e448b0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:23.695233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-43a42428-fb34-4990-ae69-537fd6ae3475 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 202 len: 0 microversion: 2.1 time: 0.068156 Dec 09 01:18:23.695847 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 543/1136] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:18:23 2021] DELETE /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:18:23.705408 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a296c2f8-d0ea-4d12-91e3-03303adb6d11 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a758040>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:23.752674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a296c2f8-d0ea-4d12-91e3-03303adb6d11 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 200 len: 344 microversion: 2.1 time: 0.050600 Dec 09 01:18:23.753360 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 594/1137] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:18:23 2021] GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:24.765195 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-910dbfd1-19f1-40df-822d-0e55aa23432c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619e2ce50>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:24.792270 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-910dbfd1-19f1-40df-822d-0e55aa23432c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] HTTP exception thrown: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. Dec 09 01:18:24.792867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-910dbfd1-19f1-40df-822d-0e55aa23432c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Returning 404 to user: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:24.793683 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-910dbfd1-19f1-40df-822d-0e55aa23432c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 404 len: 109 microversion: 2.1 time: 0.032702 Dec 09 01:18:24.794249 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 544/1138] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:18:24 2021] GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:24.808443 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-943178fe-3360-466c-8e95-2ae7227e561c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe61a79b820>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:24.835157 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-943178fe-3360-466c-8e95-2ae7227e561c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] HTTP exception thrown: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. Dec 09 01:18:24.835746 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-943178fe-3360-466c-8e95-2ae7227e561c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Returning 404 to user: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:24.836591 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-943178fe-3360-466c-8e95-2ae7227e561c tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 404 len: 109 microversion: 2.1 time: 0.032267 Dec 09 01:18:24.837109 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 595/1139] 10.222.0.23 () {58 vars in 1247 bytes} [Thu Dec 9 01:18:24 2021] DELETE /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:24.845232 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a8422dc2-95a9-4ba6-af2f-f2e4acf68a78 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Calling method '.version_select at 0x7fe619f01ca0>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:24.872235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-a8422dc2-95a9-4ba6-af2f-f2e4acf68a78 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] HTTP exception thrown: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. Dec 09 01:18:24.872821 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a8422dc2-95a9-4ba6-af2f-f2e4acf68a78 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] Returning 404 to user: Volume 7601dc4d-35cd-4752-b3f6-31771a4efe6f could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:24.873636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a8422dc2-95a9-4ba6-af2f-f2e4acf68a78 tempest-VolumesSnapshotsTestJSON-1503306435 tempest-VolumesSnapshotsTestJSON-1503306435-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f" status: 404 len: 109 microversion: 2.1 time: 0.031989 Dec 09 01:18:24.874163 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 545/1140] 10.222.0.23 () {58 vars in 1244 bytes} [Thu Dec 9 01:18:24 2021] GET /compute/v2.1/os-volumes/7601dc4d-35cd-4752-b3f6-31771a4efe6f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:41.862041 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:18:41.862604 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: Thu Dec 9 01:18:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:18:51.980818 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:51.981602 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:51.987801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:51.988354 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:51.989180 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:51.989625 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.015349 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:18:52.102694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f1bb6022-2e3c-406c-bcba-d8258a91cd38 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 204 len: 0 microversion: 2.1 time: 0.125934 Dec 09 01:18:52.103842 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 596/1141] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:18:51 2021] DELETE /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:18:52.113418 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:52.114880 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:52.121775 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.122636 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.123497 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.124174 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.383632 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:52.384518 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:52.390528 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.391078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.391971 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.392505 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.423683 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:18:52.425660 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:52.433112 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dfe6e516-877e-483a-8578-1e0aa0ab309c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1574 microversion: 2.1 time: 0.325121 Dec 09 01:18:52.433678 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 546/1142] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:52 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1574 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:52.438213 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-86eaf2ac-3631-42e7-9fa3-5163b8f58c6d req-1c15442c-5917-4018-b1a5-81a0f29d0d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:52.439830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:18:52.439830 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:18:52.447693 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-86eaf2ac-3631-42e7-9fa3-5163b8f58c6d req-1c15442c-5917-4018-b1a5-81a0f29d0d71 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.448134 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-86eaf2ac-3631-42e7-9fa3-5163b8f58c6d req-1c15442c-5917-4018-b1a5-81a0f29d0d71 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.459704 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-86eaf2ac-3631-42e7-9fa3-5163b8f58c6d req-1c15442c-5917-4018-b1a5-81a0f29d0d71 service nova] Creating event network-changed:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:18:52.465763 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-86eaf2ac-3631-42e7-9fa3-5163b8f58c6d req-1c15442c-5917-4018-b1a5-81a0f29d0d71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030704 Dec 09 01:18:52.466600 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 547/1143] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:52.509039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-4ec035eb-c9b7-466c-9059-4378a25eb5c0 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 204 len: 0 microversion: 2.1 time: 0.129420 Dec 09 01:18:52.510414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 597/1144] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:18:52 2021] DELETE /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 09 01:18:52.519596 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:52.520291 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:52.526829 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.527567 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.528536 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:52.529141 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:52.678235 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:52.686395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-5a6e5187-fd8e-47cb-b508-fbb164878e3a tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1567 microversion: 2.1 time: 0.171958 Dec 09 01:18:52.687294 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 548/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:52 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:53.450945 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:53.451571 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:53.458739 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:53.459194 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:53.459977 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:53.460413 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:53.655879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:53.663140 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-41506b6c-df4d-4a09-8b6e-726663ca57f9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1574 microversion: 2.1 time: 0.216360 Dec 09 01:18:53.663691 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 598/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:53 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:53.704127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:53.704649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:53.711884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:53.712336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:53.713107 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:53.713545 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:53.844601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:53.852172 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-ad969b78-45cf-45b3-b4aa-437650237273 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1448 microversion: 2.1 time: 0.151718 Dec 09 01:18:53.852749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 549/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:53 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:54.681039 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:54.681662 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:54.690100 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.690594 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.691460 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.691903 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.775458 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:54.783330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-95324b67-073e-4f13-a41b-f01beddab183 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1507 microversion: 2.1 time: 0.105955 Dec 09 01:18:54.784028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 599/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:54 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1507 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:18:54.802639 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-341aaf12-a2f9-43f1-9c9d-dfb1a2c449bd req-e7353da2-28f8-4d0a-a8d1-4fb98c40fe95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6445f5b-75ee-4efe-944e-2084d36836ce", "name": "network-vif-deleted", "tag": "ce47340a-b2d8-4162-9551-02036e78fb48"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:54.804403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:18:54.804403 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:18:54.811789 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-341aaf12-a2f9-43f1-9c9d-dfb1a2c449bd req-e7353da2-28f8-4d0a-a8d1-4fb98c40fe95 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.812240 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-341aaf12-a2f9-43f1-9c9d-dfb1a2c449bd req-e7353da2-28f8-4d0a-a8d1-4fb98c40fe95 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.823626 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-341aaf12-a2f9-43f1-9c9d-dfb1a2c449bd req-e7353da2-28f8-4d0a-a8d1-4fb98c40fe95 service nova] Creating event network-vif-deleted:ce47340a-b2d8-4162-9551-02036e78fb48 for instance c6445f5b-75ee-4efe-944e-2084d36836ce on hv-cinder-79053 Dec 09 01:18:54.828427 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-341aaf12-a2f9-43f1-9c9d-dfb1a2c449bd req-e7353da2-28f8-4d0a-a8d1-4fb98c40fe95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029694 Dec 09 01:18:54.829238 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 550/1149] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:18:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:54.869177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:54.870067 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:54.876316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.876960 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.878107 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.878630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.942026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-4c809244-edc6-420c-a995-254dbe5d86a2 req-1b044354-7ffd-4d32-b756-a9964d3689aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e98f0f-f551-454d-83dc-72ea335bfab1", "name": "network-vif-deleted", "tag": "5457fda6-471c-4e1e-af4a-0d995f51f52f"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:54.949268 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1a5b2feb8e4f93a4eeb90de9adb927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9af91ce42164b7d8dbeecc27f4698e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:54.951456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:18:54.951456 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:18:54.958901 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-68fa505d-1422-4994-a943-67c4a17f0cb2 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 200 len: 1218 microversion: 2.1 time: 0.093482 Dec 09 01:18:54.968105 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 600/1150] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:54 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:54.976681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-4c809244-edc6-420c-a995-254dbe5d86a2 req-1b044354-7ffd-4d32-b756-a9964d3689aa service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:54.977127 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-4c809244-edc6-420c-a995-254dbe5d86a2 req-1b044354-7ffd-4d32-b756-a9964d3689aa service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:54.992738 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-4c809244-edc6-420c-a995-254dbe5d86a2 req-1b044354-7ffd-4d32-b756-a9964d3689aa service nova] Creating event network-vif-deleted:5457fda6-471c-4e1e-af4a-0d995f51f52f for instance a5e98f0f-f551-454d-83dc-72ea335bfab1 on hv-cinder-79053 Dec 09 01:18:54.999759 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-4c809244-edc6-420c-a995-254dbe5d86a2 req-1b044354-7ffd-4d32-b756-a9964d3689aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061811 Dec 09 01:18:55.000375 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 551/1151] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:18:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:18:55.801597 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:55.802218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:55.808728 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:55.809183 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:55.809970 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:55.810431 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:55.849860 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:55.850479 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:55.850855 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.objects.instance [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lazy-loading 'fault' on Instance uuid a5e98f0f-f551-454d-83dc-72ea335bfab1 {{(pid=116068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 09 01:18:55.896471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:55.904044 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f296079b-a396-4fa1-8fd6-3c76abc68540 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 200 len: 1229 microversion: 2.1 time: 0.106829 Dec 09 01:18:55.904622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 601/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:55 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:18:55.976405 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:55.977100 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] [instance: c6445f5b-75ee-4efe-944e-2084d36836ce] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:55.984681 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:55.985245 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:55.986309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:55.986833 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:56.007007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] HTTP exception thrown: Instance c6445f5b-75ee-4efe-944e-2084d36836ce could not be found. Dec 09 01:18:56.007691 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Returning 404 to user: Instance c6445f5b-75ee-4efe-944e-2084d36836ce could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:56.008792 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-7f58da67-5b7d-4cdc-98d6-d7a693e542eb tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce" status: 404 len: 111 microversion: 2.1 time: 0.036580 Dec 09 01:18:56.009656 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 552/1153] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:55 2021] GET /compute/v2.1/servers/c6445f5b-75ee-4efe-944e-2084d36836ce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:56.176670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b3b1f8c2-fec7-4174-832e-5b3ed3a64556 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] Calling method '.version_select at 0x7fe61a7560d0>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:56.196099 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b3b1f8c2-fec7-4174-832e-5b3ed3a64556 tempest-TestShelveInstance-1638550348 tempest-TestShelveInstance-1638550348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-871543306" status: 202 len: 0 microversion: 2.1 time: 0.023145 Dec 09 01:18:56.196987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 602/1154] 10.222.0.23 () {58 vars in 1250 bytes} [Thu Dec 9 01:18:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-871543306 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:18:56.921211 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:56.922024 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:56.928644 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:56.929194 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:56.930047 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:56.930524 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:56.943478 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] HTTP exception thrown: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. Dec 09 01:18:56.944065 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Returning 404 to user: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:18:56.944876 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-293ea985-e010-48e4-8f7b-2babc0d0aa72 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 404 len: 111 microversion: 2.1 time: 0.027499 Dec 09 01:18:56.945406 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 553/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:56 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:18:57.039159 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-710136070", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503582836", "security_groups": [{"name": "tempest-secgroup-smoke-828630830"}], "block_device_mapping_v2": [{"uuid": "3741013f-8554-4c1b-a0fb-19fd6c28671d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7903c83a-1491-4cdb-8fa8-969596d0e034"}]}} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:18:57.154305 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.network.neutron [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] validate_networks() for [('7903c83a-1491-4cdb-8fa8-969596d0e034', None, None, None, None, None)] {{(pid=116068) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:18:57.547521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:18:57.547944 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image limits 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:18:57.548414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:18:57.548813 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image pref 0:0:0 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:18:57.549259 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.virt.hardware [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:18:57.558959 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:57.559473 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:57.560521 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:57.561085 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:57.583670 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:18:57.587927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.quota [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for user 145783b498ca431aab3f9fe0c958e60a and project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:18:57.646253 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Going to run 1 instances... {{(pid=116068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:18:57.648496 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3741013f-8554-4c1b-a0fb-19fd6c28671d',volume_size=None,volume_type=None)] {{(pid=116068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:18:57.786177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-c826bf66-6c5f-41c2-81b9-4273ef7400c0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751447 Dec 09 01:18:57.787001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 603/1156] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:18:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:18:57.796884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-6cdc5bf3-441a-44bb-bceb-4e2d94c1f14b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:57.797486 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-6cdc5bf3-441a-44bb-bceb-4e2d94c1f14b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:57.852247 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-6cdc5bf3-441a-44bb-bceb-4e2d94c1f14b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:57.859246 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-6cdc5bf3-441a-44bb-bceb-4e2d94c1f14b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1093 microversion: 2.1 time: 0.066091 Dec 09 01:18:57.860189 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 554/1157] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:57 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:18:58.875915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:18:58.876540 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:18:58.886937 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:58.887471 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:58.888270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:18:58.888705 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:18:58.978051 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:18:58.988674 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d99455c9-fb5d-4e41-b1a1-7fc7f7dcae7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1209 microversion: 2.1 time: 0.116415 Dec 09 01:18:58.989257 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 604/1158] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:18:58 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:00.005893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:00.006827 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:00.014117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:00.014886 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:00.015778 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:00.016450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:00.299366 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:00.307376 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-9eb5b773-7455-41d9-8b92-e6d929200bb3 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.306114 Dec 09 01:19:00.308155 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 555/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:00 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:00.779626 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-6dee1967-c0a4-4f84-bf69-b36bfa9d1e09 req-cc40d973-c3ce-4715-8d13-14d6036e80d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ff5986-d016-451e-81db-defd8de91f5e", "tag": "7e302705-9c91-42f3-9627-b6bd937fd67e"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:19:00.781877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:19:00.781877 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:19:00.793314 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-6dee1967-c0a4-4f84-bf69-b36bfa9d1e09 req-cc40d973-c3ce-4715-8d13-14d6036e80d8 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:00.794913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-6dee1967-c0a4-4f84-bf69-b36bfa9d1e09 req-cc40d973-c3ce-4715-8d13-14d6036e80d8 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:00.826330 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-6dee1967-c0a4-4f84-bf69-b36bfa9d1e09 req-cc40d973-c3ce-4715-8d13-14d6036e80d8 service nova] Creating event network-changed:7e302705-9c91-42f3-9627-b6bd937fd67e for instance d3ff5986-d016-451e-81db-defd8de91f5e on hv-cinder-79053 Dec 09 01:19:00.832247 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-6dee1967-c0a4-4f84-bf69-b36bfa9d1e09 req-cc40d973-c3ce-4715-8d13-14d6036e80d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057010 Dec 09 01:19:00.833873 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 605/1160] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:19:01.325698 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:01.326428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:01.333459 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:01.333910 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:01.334734 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:01.335171 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:01.561559 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:01.569797 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0c15155e-bc8a-4fa6-b2e4-615bcb282956 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.247803 Dec 09 01:19:01.570769 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 556/1161] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:01 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:02.588287 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:02.588988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:02.595077 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:02.595532 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:02.596316 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:02.596757 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:02.819917 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:02.827980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cac4271b-0cda-4aba-b21c-8e2f54f9f96c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.244094 Dec 09 01:19:02.828549 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 606/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:02 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:19:03.844863 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:03.846088 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:03.853233 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:03.853684 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:03.854497 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:03.854937 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:03.993989 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:04.002054 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-c746260a-2df1-4abc-8a1d-27c359b88e62 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.160814 Dec 09 01:19:04.002740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 557/1163] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:03 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:05.019366 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:05.019986 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:05.026313 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:05.026794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:05.027574 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:05.028013 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:05.166360 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:05.173721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-cfa0060c-307e-49cb-b4bf-32496adfc58a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.158117 Dec 09 01:19:05.174290 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 607/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:05 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:06.190431 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:06.191171 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:06.197288 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:06.197739 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:06.198547 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:06.198987 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:06.336278 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:06.344181 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-fc877591-9552-4d1a-84ce-fbd2b69aee3f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.157477 Dec 09 01:19:06.344749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 558/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:06 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:07.360808 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:07.361416 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:07.368704 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:07.369151 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:07.369927 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:07.370387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:07.504070 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:07.511346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-0a97e2c8-966a-416c-bc6b-5978892c5f9e tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.154248 Dec 09 01:19:07.511911 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 608/1166] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:07 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:08.528597 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:08.529212 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:08.535759 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:08.536206 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:08.536986 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:08.537425 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:08.677280 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:08.684593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a75be975-9310-49d2-9a6e-46f0b7ce4b7a tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.159685 Dec 09 01:19:08.685148 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 559/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:08 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:09.700721 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:09.701336 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:09.708951 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:09.709407 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:09.710221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:09.710688 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:09.852376 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:09.860230 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-31f0d1b5-83b3-4451-8f6e-a365e4c86dc6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.163129 Dec 09 01:19:09.860799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 609/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:09 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:10.877225 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:10.878450 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:10.884937 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:10.885395 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:10.886183 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:10.886661 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:11.015842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:11.023624 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-afed99e9-085a-4f5e-898c-9114bf1cd019 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.150064 Dec 09 01:19:11.024178 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 560/1169] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:10 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:11.411596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-137e5851-ea17-4bcb-9642-68bb27029480 req-d792ad7a-fea0-4d89-9117-607395dd57c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ff5986-d016-451e-81db-defd8de91f5e", "name": "network-vif-plugged", "status": "completed", "tag": "7e302705-9c91-42f3-9627-b6bd937fd67e"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:19:11.413418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:19:11.413418 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:19:11.421488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-137e5851-ea17-4bcb-9642-68bb27029480 req-d792ad7a-fea0-4d89-9117-607395dd57c5 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:11.422780 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-137e5851-ea17-4bcb-9642-68bb27029480 req-d792ad7a-fea0-4d89-9117-607395dd57c5 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:11.434883 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-137e5851-ea17-4bcb-9642-68bb27029480 req-d792ad7a-fea0-4d89-9117-607395dd57c5 service nova] Creating event network-vif-plugged:7e302705-9c91-42f3-9627-b6bd937fd67e for instance d3ff5986-d016-451e-81db-defd8de91f5e on hv-cinder-79053 Dec 09 01:19:11.440913 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-137e5851-ea17-4bcb-9642-68bb27029480 req-d792ad7a-fea0-4d89-9117-607395dd57c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Dec 09 01:19:11.441510 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 610/1170] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:19:12.040657 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:12.041279 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:12.047590 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:12.048049 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:12.048838 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:12.049286 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:12.183387 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:12.190604 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-bfb0999e-ae38-48bf-8757-ba31ad7b6f2d tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1264 microversion: 2.1 time: 0.153537 Dec 09 01:19:12.191159 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 561/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:12 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:13.207694 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:13.208387 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:13.214835 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:13.215288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:13.216059 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:13.216492 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:13.348538 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:13.355758 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5867b5fb-4963-49d5-ba80-c4da6d7f1aca tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1452 microversion: 2.1 time: 0.152382 Dec 09 01:19:13.356615 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 611/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:13 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:13.372462 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:19:13.373078 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:19:13.379241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:13.379687 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:13.380461 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:13.380895 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:13.513210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:19:13.521192 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-3aa89163-cb29-4c43-a7c6-79c2196acab2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1452 microversion: 2.1 time: 0.152350 Dec 09 01:19:13.521758 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 562/1173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:19:13 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:19:15.110785 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-a292011f-5d91-488e-9f77-8f6b1cd5b5d9 req-eb367f77-c533-4201-8b0e-bbfeae440f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ff5986-d016-451e-81db-defd8de91f5e", "tag": "7e302705-9c91-42f3-9627-b6bd937fd67e"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:19:15.113177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:19:15.113177 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:19:15.120850 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a292011f-5d91-488e-9f77-8f6b1cd5b5d9 req-eb367f77-c533-4201-8b0e-bbfeae440f51 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:19:15.121293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-a292011f-5d91-488e-9f77-8f6b1cd5b5d9 req-eb367f77-c533-4201-8b0e-bbfeae440f51 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:19:15.132918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-a292011f-5d91-488e-9f77-8f6b1cd5b5d9 req-eb367f77-c533-4201-8b0e-bbfeae440f51 service nova] Creating event network-changed:7e302705-9c91-42f3-9627-b6bd937fd67e for instance d3ff5986-d016-451e-81db-defd8de91f5e on hv-cinder-79053 Dec 09 01:19:15.137948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-a292011f-5d91-488e-9f77-8f6b1cd5b5d9 req-eb367f77-c533-4201-8b0e-bbfeae440f51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031473 Dec 09 01:19:15.138948 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 612/1174] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:19:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:20:21.682996 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:20:21.683613 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:20:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:20:54.463015 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2094161150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503582836", "security_groups": [{"name": "tempest-secgroup-smoke-828630830"}], "block_device_mapping_v2": [{"uuid": "f0bc33d4-581e-4d03-b815-e459d535e932", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7903c83a-1491-4cdb-8fa8-969596d0e034"}]}} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:20:54.575068 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.network.neutron [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] validate_networks() for [('7903c83a-1491-4cdb-8fa8-969596d0e034', None, None, None, None, None)] {{(pid=116067) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 09 01:20:55.235241 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 09 01:20:55.235674 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image limits 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 09 01:20:55.236150 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Flavor pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 09 01:20:55.236593 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Image pref 0:0:0 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 09 01:20:55.237007 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.virt.hardware [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 09 01:20:55.246057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:55.246550 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:55.247372 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:55.247815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:55.264297 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 09 01:20:55.268282 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.quota [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Getting quotas for user 145783b498ca431aab3f9fe0c958e60a and project 7480e21bc2664d4e94526980995f0f6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116067) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 09 01:20:55.321793 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Going to run 1 instances... {{(pid=116067) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 09 01:20:55.324815 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0bc33d4-581e-4d03-b815-e459d535e932',volume_size=None,volume_type=None)] {{(pid=116067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 09 01:20:55.442196 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-0052a8ce-842a-42ac-bf7c-54a70a5e6313 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983757 Dec 09 01:20:55.442867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 563/1175] 10.222.0.23 () {60 vars in 1146 bytes} [Thu Dec 9 01:20:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 09 01:20:55.455335 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9163b51e-5c5c-4d8d-88fc-960859fbdb66 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:20:55.456182 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9163b51e-5c5c-4d8d-88fc-960859fbdb66 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:20:55.512821 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9163b51e-5c5c-4d8d-88fc-960859fbdb66 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:20:55.519657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9163b51e-5c5c-4d8d-88fc-960859fbdb66 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1094 microversion: 2.1 time: 0.069932 Dec 09 01:20:55.520321 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 613/1176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:20:55 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:20:56.541475 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:20:56.543230 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:20:56.550075 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:56.550803 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:56.551781 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:56.552223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:56.622310 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:20:56.629708 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-deeec338-55da-4a31-bdf0-b29e0b6e27b4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1200 microversion: 2.1 time: 0.092500 Dec 09 01:20:56.630296 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 564/1177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:20:56 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:20:57.647600 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:20:57.648131 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:20:57.654173 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:57.654672 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:57.655450 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:57.655899 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:57.798624 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:20:57.807859 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-5df5dfbf-51f5-4879-b0c5-fc7ca9485894 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.163562 Dec 09 01:20:57.808527 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 614/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:20:57 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:20:58.108566 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-1e3838b2-e3d4-4a30-a1ac-e3f13b22eb03 req-e25f931f-0f4a-4ade-95f6-ac10c368ff8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9222be-d8f3-427e-879b-98c0decb3006", "tag": "64bd96fd-e7ad-48a2-a44b-81010be6b5d5"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:20:58.110412 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:20:58.110412 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:20:58.118057 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-1e3838b2-e3d4-4a30-a1ac-e3f13b22eb03 req-e25f931f-0f4a-4ade-95f6-ac10c368ff8e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:58.118424 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-1e3838b2-e3d4-4a30-a1ac-e3f13b22eb03 req-e25f931f-0f4a-4ade-95f6-ac10c368ff8e service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:58.130076 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-1e3838b2-e3d4-4a30-a1ac-e3f13b22eb03 req-e25f931f-0f4a-4ade-95f6-ac10c368ff8e service nova] Creating event network-changed:64bd96fd-e7ad-48a2-a44b-81010be6b5d5 for instance 7d9222be-d8f3-427e-879b-98c0decb3006 on hv-cinder-79053 Dec 09 01:20:58.135190 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-1e3838b2-e3d4-4a30-a1ac-e3f13b22eb03 req-e25f931f-0f4a-4ade-95f6-ac10c368ff8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176457 Dec 09 01:20:58.136689 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 565/1179] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:20:58.824467 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:20:58.825078 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:20:58.831678 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:58.832127 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:58.832904 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:20:58.833338 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:20:58.973161 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:20:58.980560 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2c8b002f-a138-4098-b0ea-15653840c2a2 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.159923 Dec 09 01:20:58.981120 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 615/1180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:20:58 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:20:59.997896 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:20:59.998617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:00.004658 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:00.005106 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:00.005875 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:00.006309 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:00.138772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:00.146048 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-60f79c58-599c-467c-9207-4958e1946665 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.152614 Dec 09 01:21:00.146632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 566/1181] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:20:59 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:01.162620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:01.163164 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:01.169357 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:01.169801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:01.170596 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:01.171029 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:01.310091 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:01.317348 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-9643ed53-cdaa-4a35-9634-d96f1b662c13 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.158684 Dec 09 01:21:01.317915 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 616/1182] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:01 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:02.334758 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:02.335376 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:02.342166 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:02.342649 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:02.343441 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:02.343884 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:02.475905 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:02.483464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-74318ea2-f9ae-46a7-9789-f63bd610ebb0 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.152407 Dec 09 01:21:02.484040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 567/1183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:02 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:03.500859 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:03.501472 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:03.507771 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:03.508219 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:03.509004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:03.509442 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:03.643211 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:03.650485 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-38722544-4432-4280-80c7-50bc88e4af7b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.153190 Dec 09 01:21:03.651374 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 617/1184] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:03 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:04.667311 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:04.667919 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:04.674137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:04.674617 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:04.675396 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:04.675835 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:04.805509 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:04.812761 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-cc342108-0e5b-4a4d-8c75-dd48390fd1d8 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.149215 Dec 09 01:21:04.813315 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 568/1185] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:04 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:21:05.829346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:05.829958 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:05.836132 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:05.836582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:05.837352 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:05.837788 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:05.972096 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:05.979983 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-256dc0ce-7407-4724-a4d8-98a686aed2e4 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.154512 Dec 09 01:21:05.980630 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 618/1186] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:05 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:06.996688 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:06.997317 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:07.003913 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:07.004362 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:07.005137 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:07.005570 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:07.137798 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:07.145144 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-dafb87bd-2053-4e7a-8d08-874ec582a813 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.152271 Dec 09 01:21:07.145710 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 569/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:06 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:08.118288 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [req-3a1e650f-9e21-462a-8afd-50b1b9cd4173 req-0f3bfa88-c64d-4603-9f20-083750be9e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9222be-d8f3-427e-879b-98c0decb3006", "name": "network-vif-plugged", "status": "completed", "tag": "64bd96fd-e7ad-48a2-a44b-81010be6b5d5"}]} {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:21:08.120361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:21:08.120361 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: warnings.warn(msg) Dec 09 01:21:08.127270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-3a1e650f-9e21-462a-8afd-50b1b9cd4173 req-0f3bfa88-c64d-4603-9f20-083750be9e4f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:08.127709 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [req-3a1e650f-9e21-462a-8afd-50b1b9cd4173 req-0f3bfa88-c64d-4603-9f20-083750be9e4f service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:08.139055 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.compute.server_external_events [req-3a1e650f-9e21-462a-8afd-50b1b9cd4173 req-0f3bfa88-c64d-4603-9f20-083750be9e4f service nova] Creating event network-vif-plugged:64bd96fd-e7ad-48a2-a44b-81010be6b5d5 for instance 7d9222be-d8f3-427e-879b-98c0decb3006 on hv-cinder-79053 Dec 09 01:21:08.144150 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [req-3a1e650f-9e21-462a-8afd-50b1b9cd4173 req-0f3bfa88-c64d-4603-9f20-083750be9e4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091093 Dec 09 01:21:08.144731 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 619/1188] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:21:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 09 01:21:08.160700 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:08.161318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:08.167731 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:08.168196 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:08.168983 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:08.169428 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:08.309542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:08.317635 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-065ab848-9cbe-482f-b8a7-5b41b7a594cf tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.160571 Dec 09 01:21:08.318201 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 570/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:08 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 09 01:21:09.336021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:09.336719 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:09.343987 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:09.344441 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:09.345221 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:09.345657 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:09.484565 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:09.491801 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-f7d40499-bc8f-458c-8ef1-9f5b38626da6 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1265 microversion: 2.1 time: 0.160285 Dec 09 01:21:09.492367 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 620/1190] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:09 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:10.508951 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:10.509563 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:10.515831 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:10.516277 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:10.517045 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:10.517477 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:10.653786 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:10.661001 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-440559d5-86a5-4ab9-865f-0f8137c3cf65 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1452 microversion: 2.1 time: 0.155740 Dec 09 01:21:10.661560 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 571/1191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:10 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:10.676881 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:21:10.677504 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:21:10.684637 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:10.685092 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:10.685876 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:10.686318 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:10.814380 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:21:10.821619 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-147f7976-ac3b-46c8-8bb3-40c744e65d77 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1452 microversion: 2.1 time: 0.148359 Dec 09 01:21:10.822169 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 621/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:21:10 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:21:12.411302 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-712cede2-1ae4-408e-b8e0-498e5d412fd2 req-aa04f611-2c9b-47c9-846d-c6690c7949c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9222be-d8f3-427e-879b-98c0decb3006", "tag": "64bd96fd-e7ad-48a2-a44b-81010be6b5d5"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:21:12.412921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:21:12.412921 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:21:12.421219 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-712cede2-1ae4-408e-b8e0-498e5d412fd2 req-aa04f611-2c9b-47c9-846d-c6690c7949c4 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:21:12.421810 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-712cede2-1ae4-408e-b8e0-498e5d412fd2 req-aa04f611-2c9b-47c9-846d-c6690c7949c4 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:21:12.433326 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-712cede2-1ae4-408e-b8e0-498e5d412fd2 req-aa04f611-2c9b-47c9-846d-c6690c7949c4 service nova] Creating event network-changed:64bd96fd-e7ad-48a2-a44b-81010be6b5d5 for instance 7d9222be-d8f3-427e-879b-98c0decb3006 on hv-cinder-79053 Dec 09 01:21:12.438443 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-712cede2-1ae4-408e-b8e0-498e5d412fd2 req-aa04f611-2c9b-47c9-846d-c6690c7949c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030898 Dec 09 01:21:12.439223 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 572/1193] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:21:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:22:01.882169 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:22:01.882675 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: Thu Dec 9 01:22:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:22:40.494879 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:40.496486 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:40.502954 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-7e68c7f6-b9dd-4144-9ec7-861100cce0ef req-dde68cb8-87f7-4819-8360-38e034712f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9222be-d8f3-427e-879b-98c0decb3006", "tag": "64bd96fd-e7ad-48a2-a44b-81010be6b5d5"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:22:40.506053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:22:40.506053 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:22:40.513454 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:40.513646 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-7e68c7f6-b9dd-4144-9ec7-861100cce0ef req-dde68cb8-87f7-4819-8360-38e034712f45 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:40.513910 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:40.514098 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-7e68c7f6-b9dd-4144-9ec7-861100cce0ef req-dde68cb8-87f7-4819-8360-38e034712f45 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:40.514739 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:40.515180 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:40.525131 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-7e68c7f6-b9dd-4144-9ec7-861100cce0ef req-dde68cb8-87f7-4819-8360-38e034712f45 service nova] Creating event network-changed:64bd96fd-e7ad-48a2-a44b-81010be6b5d5 for instance 7d9222be-d8f3-427e-879b-98c0decb3006 on hv-cinder-79053 Dec 09 01:22:40.530858 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-7e68c7f6-b9dd-4144-9ec7-861100cce0ef req-dde68cb8-87f7-4819-8360-38e034712f45 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033113 Dec 09 01:22:40.531855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 573/1194] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:22:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:22:40.540534 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:22:40.621591 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-fcf134eb-9d80-447c-ae6f-88c84263c08c tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 204 len: 0 microversion: 2.1 time: 0.130797 Dec 09 01:22:40.622098 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 622/1195] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:22:40 2021] DELETE /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:22:40.631632 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:40.632336 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:40.638629 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:40.639084 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:40.639864 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:40.640298 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:40.784585 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:40.792342 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-a74ebda4-707f-4b65-8204-4614b7e03646 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1576 microversion: 2.1 time: 0.165227 Dec 09 01:22:40.802152 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 574/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:40 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:41.809414 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:41.810117 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:41.816488 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:41.816944 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:41.817735 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:41.818176 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:41.953328 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:41.960841 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-d0e3c82a-e186-4167-aa1b-544bf3d8b875 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1458 microversion: 2.1 time: 0.155534 Dec 09 01:22:41.961405 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 623/1197] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:41 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:42.809648 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-5caa65da-4da8-4649-8f70-449804542d14 req-68a6ac93-2cf7-41b4-a74f-bbfdcd0cef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9222be-d8f3-427e-879b-98c0decb3006", "name": "network-vif-deleted", "tag": "64bd96fd-e7ad-48a2-a44b-81010be6b5d5"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:22:42.811805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:22:42.811805 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:22:42.821318 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-5caa65da-4da8-4649-8f70-449804542d14 req-68a6ac93-2cf7-41b4-a74f-bbfdcd0cef00 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:42.821842 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-5caa65da-4da8-4649-8f70-449804542d14 req-68a6ac93-2cf7-41b4-a74f-bbfdcd0cef00 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:42.835389 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-5caa65da-4da8-4649-8f70-449804542d14 req-68a6ac93-2cf7-41b4-a74f-bbfdcd0cef00 service nova] Creating event network-vif-deleted:64bd96fd-e7ad-48a2-a44b-81010be6b5d5 for instance 7d9222be-d8f3-427e-879b-98c0decb3006 on hv-cinder-79053 Dec 09 01:22:42.844925 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-5caa65da-4da8-4649-8f70-449804542d14 req-68a6ac93-2cf7-41b4-a74f-bbfdcd0cef00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039318 Dec 09 01:22:42.848893 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 575/1198] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:22:42.978190 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:42.978732 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:42.985530 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:42.985982 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:42.986799 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:42.987240 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:43.045346 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:43.052582 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-54d73bd3-0341-43f3-ae60-cfa0e8a9d007 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 200 len: 1225 microversion: 2.1 time: 0.078122 Dec 09 01:22:43.053136 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 624/1199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:42 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:44.069448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:44.070052 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: 7d9222be-d8f3-427e-879b-98c0decb3006] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:44.077591 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:44.078040 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:44.078867 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:44.079306 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:44.093371 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] HTTP exception thrown: Instance 7d9222be-d8f3-427e-879b-98c0decb3006 could not be found. Dec 09 01:22:44.093952 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Returning 404 to user: Instance 7d9222be-d8f3-427e-879b-98c0decb3006 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:22:44.094801 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-88ea2ea9-7780-444b-802f-37230e8a8898 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006" status: 404 len: 111 microversion: 2.1 time: 0.029460 Dec 09 01:22:44.095324 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 576/1200] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:44 2021] GET /compute/v2.1/servers/7d9222be-d8f3-427e-879b-98c0decb3006 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:22:47.130988 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:47.132107 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:47.132855 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-f7db1a98-f5cd-42c1-9612-a51e0111fa1c req-0c47ccaf-fedf-41c8-9693-a75d32b6b718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ff5986-d016-451e-81db-defd8de91f5e", "tag": "7e302705-9c91-42f3-9627-b6bd937fd67e"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:22:47.134347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:22:47.134347 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:22:47.139084 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:47.139620 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:47.140493 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:47.141004 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:47.141742 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-f7db1a98-f5cd-42c1-9612-a51e0111fa1c req-0c47ccaf-fedf-41c8-9693-a75d32b6b718 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:47.142186 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-f7db1a98-f5cd-42c1-9612-a51e0111fa1c req-0c47ccaf-fedf-41c8-9693-a75d32b6b718 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:47.153594 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-f7db1a98-f5cd-42c1-9612-a51e0111fa1c req-0c47ccaf-fedf-41c8-9693-a75d32b6b718 service nova] Creating event network-changed:7e302705-9c91-42f3-9627-b6bd937fd67e for instance d3ff5986-d016-451e-81db-defd8de91f5e on hv-cinder-79053 Dec 09 01:22:47.159592 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-f7db1a98-f5cd-42c1-9612-a51e0111fa1c req-0c47ccaf-fedf-41c8-9693-a75d32b6b718 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030272 Dec 09 01:22:47.160782 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 577/1201] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:22:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:22:47.170980 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Going to try to terminate instance {{(pid=116068) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 09 01:22:47.254946 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-b2ca00ca-8141-4223-a325-442d5def68e9 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 204 len: 0 microversion: 2.1 time: 0.127422 Dec 09 01:22:47.255557 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 625/1202] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:22:47 2021] DELETE /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 09 01:22:47.265795 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:47.266542 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:47.273476 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:47.273930 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:47.274749 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:47.275193 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:47.416799 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.policy [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116067) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:47.426260 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-1602bcda-1b9d-4d42-bed5-c645335b451b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1577 microversion: 2.1 time: 0.165916 Dec 09 01:22:47.427206 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 578/1203] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:47 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:48.444819 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:48.445525 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:48.452311 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:48.452765 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:48.453550 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:48.453993 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:48.588028 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:48.595953 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-a10505c1-bbcf-4c57-bc39-e021b761c35b tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1458 microversion: 2.1 time: 0.155248 Dec 09 01:22:48.596558 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 626/1204] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:48 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:49.366464 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [req-315a5731-4ca5-42bc-be30-7cc9fee02b00 req-45b5fdb0-9d77-446e-a29d-f7f8d2c1a3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ff5986-d016-451e-81db-defd8de91f5e", "name": "network-vif-deleted", "tag": "7e302705-9c91-42f3-9627-b6bd937fd67e"}]} {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 09 01:22:49.368093 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 09 01:22:49.368093 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: warnings.warn(msg) Dec 09 01:22:49.377102 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-315a5731-4ca5-42bc-be30-7cc9fee02b00 req-45b5fdb0-9d77-446e-a29d-f7f8d2c1a3b6 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:49.377553 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [req-315a5731-4ca5-42bc-be30-7cc9fee02b00 req-45b5fdb0-9d77-446e-a29d-f7f8d2c1a3b6 service nova] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:49.388947 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.compute.server_external_events [req-315a5731-4ca5-42bc-be30-7cc9fee02b00 req-45b5fdb0-9d77-446e-a29d-f7f8d2c1a3b6 service nova] Creating event network-vif-deleted:7e302705-9c91-42f3-9627-b6bd937fd67e for instance d3ff5986-d016-451e-81db-defd8de91f5e on hv-cinder-79053 Dec 09 01:22:49.393834 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [req-315a5731-4ca5-42bc-be30-7cc9fee02b00 req-45b5fdb0-9d77-446e-a29d-f7f8d2c1a3b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031023 Dec 09 01:22:49.394453 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 579/1205] 10.222.0.23 () {64 vars in 1317 bytes} [Thu Dec 9 01:22:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 09 01:22:49.612245 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:49.612794 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:49.618975 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:49.619423 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:49.620189 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:49.620622 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:49.681599 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.policy [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145783b498ca431aab3f9fe0c958e60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7480e21bc2664d4e94526980995f0f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116068) authorize /opt/stack/nova/nova/policy.py:199}} Dec 09 01:22:49.690293 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-95d9276b-67f1-436e-9f21-e8dd4342cd10 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 200 len: 1224 microversion: 2.1 time: 0.081702 Dec 09 01:22:49.691045 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 627/1206] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:49 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 09 01:22:50.708448 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:50.709138 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: d3ff5986-d016-451e-81db-defd8de91f5e] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:50.715341 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:50.715740 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:50.717471 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:50.717933 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:50.730622 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] HTTP exception thrown: Instance d3ff5986-d016-451e-81db-defd8de91f5e could not be found. Dec 09 01:22:50.731210 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Returning 404 to user: Instance d3ff5986-d016-451e-81db-defd8de91f5e could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:22:50.732261 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-02230f80-7bad-4bc1-aae8-7bee5802e67f tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e" status: 404 len: 111 microversion: 2.1 time: 0.028095 Dec 09 01:22:50.732966 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 580/1207] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:50 2021] GET /compute/v2.1/servers/d3ff5986-d016-451e-81db-defd8de91f5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:22:51.162580 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:51.163106 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.compute.api [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116068) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:51.169517 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:51.170001 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:51.170823 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:51.171270 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG oslo_concurrency.lockutils [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:51.184007 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.wsgi [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] HTTP exception thrown: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. Dec 09 01:22:51.184595 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Returning 404 to user: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. {{(pid=116068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:22:51.186218 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-2fc1319c-9c2c-479e-90f0-39a5b11ac355 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 404 len: 111 microversion: 2.1 time: 0.027303 Dec 09 01:22:51.186784 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 628/1208] 10.222.0.23 () {58 vars in 1238 bytes} [Thu Dec 9 01:22:51 2021] DELETE /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:22:51.194800 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '>' {{(pid=116067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:51.195412 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.compute.api [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] [instance: a5e98f0f-f551-454d-83dc-72ea335bfab1] Fetching instance by UUID {{(pid=116067) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 09 01:22:51.203662 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:51.204117 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:51.204899 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 01:22:51.205340 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG oslo_concurrency.lockutils [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Lock "43af9349-0699-4dfb-9be6-d0c0382396d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 01:22:51.218556 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.wsgi [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] HTTP exception thrown: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. Dec 09 01:22:51.219139 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: DEBUG nova.api.openstack.wsgi [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Returning 404 to user: Instance a5e98f0f-f551-454d-83dc-72ea335bfab1 could not be found. {{(pid=116067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 09 01:22:51.219978 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO nova.api.openstack.requestlog [None req-b9fd8dcb-06f7-4117-ac19-2d41783f3074 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1" status: 404 len: 111 microversion: 2.1 time: 0.028983 Dec 09 01:22:51.220496 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: [pid: 116067|app: 0|req: 581/1209] 10.222.0.23 () {58 vars in 1235 bytes} [Thu Dec 9 01:22:51 2021] GET /compute/v2.1/servers/a5e98f0f-f551-454d-83dc-72ea335bfab1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 09 01:22:52.493918 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: DEBUG nova.api.openstack.wsgi [None req-bd26ad8f-393c-4400-9a09-78aea9d79744 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] Calling method '.version_select at 0x7fe61ab7f040>' {{(pid=116068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 09 01:22:52.515333 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO nova.api.openstack.requestlog [None req-bd26ad8f-393c-4400-9a09-78aea9d79744 tempest-TestVolumeBootPattern-167814843 tempest-TestVolumeBootPattern-167814843-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-503582836" status: 202 len: 0 microversion: 2.1 time: 0.024961 Dec 09 01:22:52.515947 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: [pid: 116068|app: 0|req: 629/1210] 10.222.0.23 () {58 vars in 1259 bytes} [Thu Dec 9 01:22:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-503582836 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 09 01:23:41.701772 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:23:41.702433 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:23:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:23:54.579546 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:23:54.580601 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:23:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:25:21.899686 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:25:21.900216 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: Thu Dec 9 01:25:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:25:35.502281 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:25:35.503021 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: Thu Dec 9 01:25:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:25:39.644026 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:25:39.644605 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:25:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:25:48.258789 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:25:48.259363 dv-cinder-790535-20-iscsi devstack@n-api.service[116068]: Thu Dec 9 01:25:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:27:01.719411 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:27:01.720028 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 09 01:27:14.598253 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 09 01:27:14.598984 dv-cinder-790535-20-iscsi devstack@n-api.service[116067]: Thu Dec 9 01:27:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!